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Abstract 

Inertial  navigation  systems  and  GPS  systems  have  revolutionized  the  world  of 
navigation.  Inertial  systems  are  incapable  of  being  jammed  and  are  the  backbone 
of  most  navigation  systems.  GPS  is  highly  accurate  over  long  periods  of  time,  and 
it  is  an  excellent  aid  to  inertial  navigation  systems.  However,  as  a  military  force  we 
must  be  prepared  to  deal  with  the  denial  of  the  GPS  signal.  This  thesis  seeks  to 
determine  if,  via  simulation,  it  is  viable  to  aid  an  INS  with  visual  measurements. 
Visual  measurements  represent  a  source  of  data  that  is  essentially  incapable  of  being 
jammed,  and  as  such  they  could  be  highly  valuable  for  improving  navigation  accuracy 
in  a  military  environment. 

The  simulated  visual  measurements  are  two  angles  formed  from  the  aircraft 
with  respect  to  a  target  on  the  ground.  Only  one  target  is  incorporated  into  this 
research.  Five  different  measurement  combinations  were  incorporated  into  a  Kalman 
filter  and  compared  to  each  other  over  a  six-minute  circular  navigation  orbit.  The 
measurement  combinations  included  were  with  respect  to  the  navigation  orbit:  1) 
GPS  signals  throughout  the  orbit,  2)  no  measurements  during  the  orbit,  3)  simu¬ 
lated  barometric  measurements  during  the  orbit,  4)  simulated  barometric  and  visual 
measurements  during  the  orbit,  5)  and  visual  measurements  only  during  the  orbit. 

The  visual  measurements  were  shown  to  significantly  improve  navigation  accu¬ 
racy  during  a  GPS  outage,  decreasing  the  total  3-dimensional  error  after  six  minutes 
without  GPS  from  350m  to  50m  (with  visual  measurements).  The  barometric/visual 
measurement  formulation  was  the  most  accurate  non-GPS  combination  tested,  with 
the  pure  visual  measurement  formulation  being  the  next  best  visual  measurement 
configuration.  The  results  obtained  indicate  visual  measurements  can  effectively  aid 
an  INS.  Ideas  for  follow-on  work  are  also  presented. 
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Tightly- Coupled  Image- Aided  Inertial  Navigation  System  via  a 

Kalman  Filter 


1.  Introduction 

This  thesis  is  the  culmination  of  a  course  of  study  at  the  Air  Force  Institute 
of  Technology  (AFIT)  in  navigation  theory,  along  with  a  year  at  USAF  Test  Pilot 
School  (TPS).  The  academic  portion  dealt  with  the  incorporation  of  visual  mea¬ 
surements  into  a  navigation  Kalman  filter.  This  work  was  performed  at  AFIT.  The 
actual  flight  test  took  place  within  the  TPS  curriculum.  The  flight  test  (project 
PEEPING  TALON  [2])  supported  the  AFIT  research  and  also  a  limited  evaluation 
of  a  camera  system  on  the  T-38  aircraft  (the  aircraft  was  specifically  modified  for 
this  test).  Certain  difficulties  led  to  the  use  of  simulated  visual  measurements  rather 
than  measurements  from  the  collected  images. 

1.1  Background 

This  research  is  in  the  area  of  navigation,  which  is  the  art  and  science  of  mov¬ 
ing  from  one  place  to  another.  The  type  and  quality  of  system(s)  used  determines 
the  accuracy  with  which  the  navigation  occurs.  Many  different  systems  have  been 
used  for  navigation.  Two  of  these  systems  are  considered  mainstays  of  modern  nav¬ 
igation.  These  systems  are  the  inertial  navigation  system  (INS)  [18]  and  the  Global 
Positioning  System  (GPS)  [18:371].  This  research  investigates  the  incorporation  of 
a  new  type  of  visual  measurement  with  the  aforementioned  two  navigation  systems. 
The  INS  and  GPS  systems  are  described  in  limited  detail  in  Sections  1.1.1  and  1.1.2, 
while  the  visual  measurements  and  their  effects  are  discussed  in  much  greater  detail, 
as  they  are  the  thrust  of  this  research. 
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1.1.1  Inertial  Navigation  Systems.  Inertial  systems  sense  specific  force 
and  rotation.  These  force  and  rotation  measurements  are  combined  with  knowledge 
about  the  Earth’s  rotation  and  gravitational  field  and  can  be  used  to  determine 
vehicular  movement. 

The  most  important  components  in  an  INS  are  accelerometers,  gyroscopes  and 
a  computer.  The  accelerometers  and  gyroscopes  are  sensors  which  provide  specific 
force  and  angular  velocity  measurements,  respectively.  These  measurements  are  used 
by  the  computer  to  generate  vehicle  position,  velocity,  attitude  and  time  (PVAT)  in 
a  chosen  coordinate  reference  frame  by  using  the  necessary  navigation  equations  for 
that  frame.  The  computer  is  used  for  required  computations  and  to  track  vehicle 
movement.  Inertial  systems  have  become  vital  aircraft  systems  tied  to  the  efficient 
mission  performance  of  civil  and  military  aircraft.  In  many  cases  they  would  be 
unable  to  perform  their  missions  at  all  without  an  INS.  These  inertial  navigation 
systems  are  very  effective  and  offer  many  advantages. 

One  of  the  main  benefits  of  inertial  systems  is  their  passive  nature.  They 
emit  no  detectable  signature  and  are  incapable  of  being  jammed.  However,  inertial 
systems  require  several  key  items  to  be  effective.  The  first  item  is  accurate  position 
information  during  alignment.  Any  position  error  during  alignment  will  grow  over 
time  (and  there  is  always  a  position  error  between  that  entered  into  the  INS  and  the 
actual  position).  This  rate  of  growth  is  associated  with  the  quality  of  the  gyroscopes. 
A  large  alignment  error  with  high-quality  gyroscopes  might  actually  be  better  than 
a  small  alignment  error  with  low-quality  gyroscopes.  These  systems  also  require  a 
lengthy  alignment  time.  If  both  of  these  requirements  are  not  met,  even  the  most 
accurate  INS  can  be,  or  become,  worthless.  The  quality  of  the  accelerometers  and 
gyroscopes  are  another  source  of  error.  Even  the  highest  quality  sensors  are  prone  to 
some  error.  All  of  these  errors  integrate,  and  an  INS  system  will  drift  away  from  its 
actual  position  over  time.  The  INS  drift  problem  brought  about  the  need  to  update 
the  INS  during  long  flights.  The  updates  provided  by  these  outside,  additional 
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measurements,  are  used  to  improve  INS  accuracy  by  bounding,  or  damping,  the  error 
growth  inherent  to  the  INS.  However,  some  of  these  measurements  are  cumbersome 
to  obtain  or  not  always  available.  Some  of  these  types  of  update  measurements  are 
[6:293-294]: 

1.  Altitude  sensors 

(a)  Barometric  Altimeter 

(b)  Radar  Altimeter 

2.  Forward-Looking  Infrared  (FLIR) 

3.  GPS 

4.  Heads  Up  Display  (HUD) 

5.  Long-Range  Navigation  (LORAN) 

6.  Radio  Detection  and  Ranging  (RADAR) 

7.  Star  Trackers 

8.  Tactical  Air  Navigation  (TACAN) 

9.  Overflying  a  known  geographical  point 

Historically,  new  types  of  measurements  have  been  integrated  into  the  INS 
solution  as  they  have  became  available.  One  of  the  best  measurements  for  aiding  an 
INS  was  provided  by  GPS. 

1.1.2  GPS  Systems.  The  Global  Positioning  System  is  a  system  of  satel¬ 
lites  in  medium  earth  orbit  that  transmits  signals  to  receivers  on  the  Earth’s  surface, 
or  flying  in  the  earth’s  atmosphere,  or  even  in  space.  These  receivers  are  capable  of 
determining  their  own  position  if  at  least  four  satellites  are  visible  to  that  particular 
receiver.  GPS  systems  do  not  require  any  alignment  time  (other  than  that  required 
to  lock  onto  the  satellite  signals)  since  there  are  no  internal  mechanical  components. 
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GPS  is  highly  accurate,  does  not  drift  over  time,  and  is  almost  continuously  avail¬ 
able  for  many  typical  applications.  Therefore,  GPS  is  a  very  promising  new  type  of 
measurement  for  integration  with  an  INS.  This  was  mainly  due  to  the  error  charac¬ 
teristics  of  the  GPS  being  beneficial  in  limiting  INS  weaknesses  (most  notably  the 
INS  errors  growing  or  drifting  over  time). 

1.1.3  Integrated  INS/GPS  Systems.  It  was  seen  above  that  INS  systems 
have  strengths  and  weaknesses,  as  do  GPS  systems.  INS  systems  are  very  accurate 
over  short  periods  of  time  (i.e.,  they  are  sensitive  to  high  frequency  dynamics),  and 
their  error  characteristics  grow  slowly  over  time.  The  INS  is  capable  of  generating 
vehicle  body  orientation  (which  is  very  important  in  aircraft  and  submarines  for 
which  outside  visual  references  may  be  unavailable).  GPS  systems  are  not  highly 
accurate  over  short  periods  of  time,  but  they  are  over  long  periods  of  time.  They 
are  not  capable  of  generating  vehicle  body  orientation  (unless  multiple  antennas  are 
used  along  with  some  additional  processing).  Luckily,  INS  weaknesses  are  compen¬ 
sated  for  by  GPS  strengths,  and  GPS  weaknesses  are  compensated  by  INS  strenths. 
As  a  result,  these  systems  are  often  integrated  together  to  take  advantage  of  these 
strengths  and  reduce  their  individual  weaknesses  [6:342],  This  is  typically  accom¬ 
plished  via  a  Kalman  filter  (see  Chapter  2  for  a  discussion  on  Kalman  filters).  There 
are  different  ways  to  integrate  INS  and  GPS  [13],  but  the  method  used  in  this  re¬ 
search  is  the  only  method  that  will  be  described  in  this  thesis.  The  method  that 
is  used  is  a  tightly-coupled  integration.  The  GPS  measurement  is  a  pseudorange 
measurement  from  each  visible  satellite.  The  INS  generates  its  own  estimate  of  this 
same  pseudorange  measurement.  These  two  measurements  are  differenced  to  obtain 
a  “measurement”,  which  is  then  the  input  into  the  error  state  Kalman  filter.  This 
method  of  integration  offers  two  advantages.  First,  even  a  single  satellite  can  be 
used  to  update  position,  velocity  and  attitude  (PVA),  rather  than  the  four  being 
required  for  the  GPS  itself  to  determine  its  own  position  (such  a  GPS-alone  solution 
is  required  in  an  alternative  integration  method  known  as  “loose-coupling”).  Second, 
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the  measurement  is  still  in  its  raw  form  and  has  not  been  previously  processed  by  an¬ 
other  filter.  Kalman  filters  work  better  with  raw  measurements  than  with  data  that 
has  already  been  processed  [17:292],  Such  tightly-coupled  INS/GPS  systems  can  be 
highly  accurate;  however,  their  reliance  on  GPS  can  lead  to  potential  problems. 

1.1.4  Current  Trend  in  Navigation  Systems.  Many  military  systems  have 
become  heavily  GPS-dependent.  The  trend  is  toward  low-cost,  lower  quality  iner¬ 
tial  systems  that  are  integrated  with  GPS.  This  is  especially  true  in  the  realm  of 
micro-electro  mechanical  systems  (MEMS),  in  which  high  quality  inertial  systems  are 
not  currently  available  due  to  technological  limitations.  Economics  might  drive  the 
low-cost,  lower  quality  inertial  systems  even  after  the  technological  limitations  have 
been  overcome.  This  is  even  true  in  the  world  of  aircraft.  The  C-141C  navigation 
system  relies  on  GPS  so  heavily  that  the  original  INS  equipment  from  the  C-141B 
was  retained  in  the  system  and  integrated  with  GPS  (even  though  the  original  INS 
systems  were  old  and  not  terribly  accurate).  This  was  deemed  appropriate,  due  to 
the  accuracies  involved  with  GPS.  In  such  systems,  problems  arise  in  the  event  of 
a  GPS  outage,  and  this  is  the  primary  motivation  for  this  research.  The  potential 
problems  caused  by  a  GPS  outage  are  discussed  below  in  Sections  1.1.5  and  1.1.6. 

1.1.5  How  GPS  Dependence  Affects  Aircraft.  Typical  aircraft  sortie  dura¬ 
tions  vary  from  approximately  an  hour  to  many  hours  of  flight  time.  Inertial  errors 
grow  over  time  unless  they  are  corrected  in  some  way,  and  this  is  where  GPS  shows 
its  strengths.  However,  a  problem  arises  when  the  GPS  signal  is  no  longer  available. 
These  effects  are  felt  throughout  the  spectrum  of  aircraft  type,  as  described  below 
(with  a  military  emphasis). 

1.1. 5.1  How  GPS  Loss  Affects  Strategic  Airlift.  A  typical  strategic 
airlifter  mission  can  easily  last  eight  hours  or  longer,  and  can  have  an  ocean  crossing 
during  the  flight.  Loss  of  the  GPS  signal  and  reliance  on  the  on-board  INS  systems 
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can  negatively  impact  two  important  areas.  First,  lack  of  radar  coverage  over  the 
world’s  oceans  causes  aircraft  deconfliction  to  be  implemented  by  assigning  aircraft 
to  fly  pre-detcrmined  routes  at  specific  altitudes.  This  is  performed  via  voice  or  data 
communication  over  high-frequency  (HF)  radio  waves.  There  is  no  way  to  determine 
if  an  airplane  is  where  it  is  supposed  to  be,  other  than  its  own  on-board  systems. 
An  aircraft  could  easily  be  misplaced  on  the  jet  route  as  it  unknowingly  reports  a 
faulty  location  to  air  traffic  control  (ATC).  The  aircraft  could  even  be  completely  off 
the  jet  route.  The  second  area  impacted  by  GPS  signal  loss  is  coastal  penetration. 
Aircraft  “coasting  in”  to  another  country  are  required  to  pass  over  certain  areas  so 
they  can  be  controlled  and  de-conflicted  with  other  air  traffic.  An  aircraft  using  only 
an  INS  could  easily  “coast  in”  miles  from  the  intended  location. 

1. 1.5.2  How  GPS  Loss  Affects  Tactical  Airlift.  Tactical  airlifters 
don’t  often  travel  the  same  distances  strategic  airlifters  do,  but  they  suffer  from 
their  own  particular  navigation  problems.  Aircraft  like  the  C-130  and  other  special 
operations  aircraft  are  often  required  to  transit  areas  in  a  clandestine  manner  at 
night,  while  offering  minimal  emissions  to  the  outside  world.  This  difficulty  is  some¬ 
times  compounded  by  having  to  perform  this  mission  over  featureless  expanses  of 
water  or  desert,  while  retaining  the  need  to  arrive  at  a  particular  location  without 
error.  INS-only  systems  cannot  typically  perform  this  type  of  mission  if  the  flying 
time  approaches  even  one  hour. 

1. 1.5.3  How  GPS  Loss  Affects  Tactical  Fighters.  Tactical  fighters  are 
often  required  to  take  off  at  night,  fly  over  enemy  territory  without  being  detected, 
attack  targets  and  return  home  without  being  shot  down.  Aircraft  of  this  type  often 
fly  under  high  g-forces,  in  extreme  attitudes,  and  these  flight  conditions  can  change 
very  rapidly.  Such  an  environment  can  make  it  even  more  difficult  for  an  inertial 
system  to  operate  accurately.  PVAT  is  extremely  important  to  these  types  of  aircraft, 
as  they  are  often  required  to  pass  this  information  to  munitions  before  they  can  be 
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released  from  the  host  aircraft.  Errors  in  the  aircraft’s  navigation  solution  naturally 
translate  directly  to  a  weapon. 

1. 1.5.4  How  GPS  Loss  Affects  Datalink  Systems.  Datalink  is  be¬ 
coming  much  more  predominant,  and  this  area  offers  some  very  unique  challenges. 
Aircraft  are  becoming  capable  of  transmitting  and  receiving  very  useful  information 
while  in-flight.  This  information  comes  in  many  forms: 

1.  Wingman  location 

2.  Radar  data  to  include  radar  lock  and  weapon  fly-out  information 

3.  Target  location 

4.  Downed  pilot  location 

5.  Ground  threats 

6.  Friendly  or  neutral  ground  personnel 

Some  of  this  information  requires  very  accurate  position  data;  otherwise  it  is 
not  only  useless,  it  can  lead  aircrew  into  potentially  dangerous  situations  or  geo¬ 
graphical  areas.  One  particular  area  of  concern  is  the  geographic  correlation  of  data. 
This  is  an  extremely  complex  task,  and  this  must  often  occur  between  dissimilar 
platforms.  Accurately  passing  coordinates  between  aircraft  is  one  basis  for  correlat¬ 
ing  two  separate  sources  of  data  into  one.  This  correlation  can  increase  the  accuracy 
of  the  information  known  about  the  target  aircraft  (position,  velocity,  heading,  radar 
parameters,  etc).  A  certain  amount  of  navigation  error  could  cause  the  previously 
mentioned  correlation  to  not  occur.  For  example,  a  hostile  contact  reported  by 
an  airborne  warning  and  control  system  (AWACS)  aircraft  to  a  fighter  aircraft  via 
datalink  might  not  properly  resolve  with  the  fighter  aircraft’s  own  radar  detection 
of  the  same  hostile  contact  if  one  of  the  aircraft  has  navigation  errors.  This  would 
cause  both  contacts  to  appear  on  the  fighter  aircraft  radar  scope.  This  can  cause 
a  great  deal  of  confusion,  and  cause  the  fighter  aircraft  to  waste  time,  energy,  and 
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even  weapons  on  a  false  target.  This  false  target  could  even  potentially  drive  tactical 
decisions.  There  are  many  other  similar  issues  related  to  the  datalink  area.  It  is  safe 
to  say  that  navigation  errors  cause  significant  problems  for  datalink  systems. 

1.1.6  How  GPS  Dependence  Affects  Munitions.  Many  of  the  new  weapons 
being  developed  for  the  US  Air  Force  (USAF)  are  also  heavily  GPS-dependent.  These 
weapons  fill  a  much-needed  niche  that  cannot  be  filled  by  the  highly  accurate  laser 
guided  bombs  (LGB)  already  in  the  inventory.  LGBs  are  not  all-weather  weapons. 
The  target  must  be  visible  to  the  laser  designator,  and  must  be  visible  to  the  weapon 
a  p re-determined  time  and  distance  from  the  target.  This  time  and  distance  is 
largely  dependent  on  the  type  of  weapon  and  the  geometry  of  the  attack.  The  new 
GPS  weapons  are  all-weather  weapons  that  are  not  restricted  by  cloud  cover,  high 
humidity,  or  other  problems  associated  with  LGBs.  Many  of  these  new  systems  are 
mated  with  low-cost  inertial  systems.  Therefore,  these  systems  require  either  a  short 
operating  duration  to  keep  the  INS  errors  from  drifting,  or  they  must  be  integrated 
with  GPS.  The  problem  occurs  when  the  flight  duration  is  long  and/or  the  GPS 
signal  is  lost.  In  such  cases,  the  inertial  errors  grow  rapidly  until  the  PVA  solution  is 
no  longer  usable.  Some  of  these  new  munitions  are  the  Joint  Direct  Attack  Munition 
(JDAM)  [12],  Joint  Air-to-Surface  Standoff  Missile  (JASSM)  [10]  and  Joint  Stand¬ 
off  Weapon  (JSOW)  [11].  Some  of  these  weapons  are  essentially  point  weapons,  in 
that  they  need  to  hit  very  close  to  the  target  to  be  effective.  A  loss  of  GPS  during 
the  weapon  fall  time  could  cause  the  weapon  to  be  completely  ineffective  by  missing 
the  target.  This  miss  distance  need  not  be  very  large  for  a  point  weapon  to  lose 
effectiveness.  Even  some  of  the  area  munitions  could  potentially  hit  far  enough  away 
from  their  intended  impact  point  to  be  ineffective.  A  new  type  of  visual  measurement 
might  help  alleviate  some  of  the  problems  associated  with  GPS  signal  loss  by  keeping 
the  INS  from  drifting  during  a  long  fall  time.  Visual  measurements  could  also  be  used 
with  a  target  recognition  system  to  refine  the  desired  impact  point  as  the  weapon 
approaches  a  target. 
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1.2  Problem  to  be  Solved 


1.2.1  Do  Visual  Measurements  Enhance  Navigation  Accuracy?  It  has  been 
shown  that  INS/GPS  systems  are  vulnerable  to  loss  of  the  GPS  signal  (especially 
those  systems  outfitted  with  low-cost  inertial  equipment).  Many  of  these  systems  are 
equipped  with,  or  could  be  equipped  with,  visual  sensors  of  some  type.  This  visual 
equipment  could  be  used  to  provide  measurements  to  the  navigation  Kalman  filter 
to  update  the  navigation  solution.  These  measurements  could  increase  accuracy  at 
all  times  (with  and  without  GPS  being  available),  but  could  prove  invaluable  during 
times  of  GPS  system  outages.  A  system  of  this  type  could  also  be  used  to  determine 
target  coordinates  passively.  This  research  seeks  to  determine  the  answers  to  these 
questions. 

Specifically,  simulated  visual  measurements  will  be  incorporated  into  the  nav¬ 
igation  Kalman  filter,  with  and  without  GPS,  and  compared  to  a  truth  source  to 
determine  if  the  inclusion  of  the  visual  measurements  increases  navigation  system 
performance.  These  simulated  measurements  will  be  generated  during  a  portion  of 
the  sortie  when  the  aircraft  is  orbiting  around  a  particular  target  area.  This  is  so  the 
same  target  area  will  be  available  to  generate  measurements  that  do  not  disappear 
from  view. 

1.3  Scope 

This  research  is  a  navigation  thesis  and  not  a  signal  processing  one.  Therefore, 
no  effort  was  made  to  obtain  visual  measurements  via  digital  techniques.  There  are 
methods  available,  but  they  can  be  difficult  and  time  consuming  to  implement.  Some 
of  these  methods  will  be  briefly  reviewed  in  the  Literature  Review  section  (Section 
1.4).  Actual  visual  measurements  were  extracted  even  though  simulated  data  was 
used  in  the  analysis.  A  simple  hand/eye  technique  was  used  to  capture  this  data. 
This  data  is  available,  and  it  will  be  incorporated  into  the  Liter  at  a  later  time. 
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The  data  was  post-processed,  due  to  the  increased  burden  imposed  by  real-time 
processing. 

1.4  Literature  Review 

There  is  an  abundance  of  research  regarding  navigation,  motion  estimation 
using  visual  techniques,  and  a  combination  of  the  two  topics.  Much  of  the  latter 
research  is  limited  to  ground  navigation  or  image  identification  and  is  fundamentally 
different  than  that  proposed  in  this  work.  Also,  much  of  the  research  is  focused  on 
the  optical  area  only,  and  does  not  incorporate  inertial  systems,  GPS  or  Kalman 
filter  theory.  The  term  navigation,  as  it  is  used  in  many  of  these  articles,  refers  to 
the  ability  to  move  around  in  some  autonomous  fashion,  but  does  not  refer  to  the 
type  of  navigation  used  here,  i.e.,  generating  PVAT  via  an  aided-INS. 

1.4-1  Navigation  Using  Imaging  Techniques.  Current  theory  breaks  motion 
estimation  into  two  parts  [9,  15],  detcrmineing  inter- frame  image  motion  and  using 
image  motion  to  estimate  camera  motion.  So,  inter-frame  image  motion  is  typically 
determined  by  either  the  optic  flow  constraint  equation  (Equation  (1.1))  or  some 
type  of  correspondence  (matching)  technique.  Some  estimate  of  motion  from  frame 
to  frame  is  generated  via  the  first  step,  and  this  information  is  used  in  the  second 
step  to  back  out  the  motion  of  the  camera.  Whether  Equation  (1.1)  or  a  matching 
technique  is  used,  the  end  process  generates  measurements  that  can  be  incorporated 
into  a  Kalman  filter.  This  research  will  implement  a  simplistic  matching  technique. 
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1. 4-1.1  Optic  Flow  Constraint  Equation  Techniques.  The  first  type  of 
inter-frame  motion  estimation  technique  relies  upon  solving  the  optic  flow  constraint 
equation,  Equation  (1.1)  [19]: 


d  E 
~dt 


WE  ■  v 


(i.i) 


where: 

E  is  intensity 

VE  is  the  gradient  of  the  intensity 
v  is  object  velocity 


Optic  flow  is  the  apparent  motion  of  brightness  patterns  in  an  image  [1,  19].  This 
method  generates  a  motion  vector  for  each  element  in  the  image.  Some  of  the 
methods  reviewed  produced  vectors  that  were  wildly  inaccurate  and  unusable  due 
to  camera  shock,  vibration  and  inherent  inadequacies  in  the  optic  flow  estimation 
technique.  The  second  type  of  inter-frame  motion  estimation  techniques  are  corre¬ 
spondence  techniques. 


1. 4-1.2  Correspondence  Based  Techniques.  This  technique  is  a  match¬ 
ing  type  of  solution,  and  it  also  uses  apparent  motion  of  image  brightness  patterns. 
However,  motion  vectors  are  not  generated  for  each  image  element.  Objects  are 
identified  in  one  image  and  located  again  in  the  preceding  images.  The  displacement 
between  objects  over  time  is  used  to  estimate  the  inter-frame  velocity,  whether  it  be 
translational  and/or  rotational  velocity. 


1 . 5  Methodology 

The  original  idea  was  to  use  a  simple  technique  on  a  sequence  of  images  to 
generate  angular  information  for  incorporation  into  the  Kalman  filter.  The  accuracy 
increase  due  to  these  measurements  was  to  be  determined  experimentally  using  data 
obtained  during  the  flight  test  phase  of  project  PEEPING  TALON  at  TPS.  This 
would  be  accomplished  by  comparing  system  accuracy  with  visual  measurements 
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being  incorporated,  to  system  accuracy  without  visual  measurements  being  incorpo¬ 
rated.  This  data  was  collected,  but  difficulties  with  the  Kalman  filter  algorithm  and 
several  technical  problems  caused  simulated  data  to  be  generated,  and  used,  for  the 
actual  analysis  of  the  algorithm.  The  flight  test  images  will  be  incorporated  into  the 
navigation  system  once  the  technical  difficulties  have  been  overcome. 

1.6  Assumptions 

It  is  assumed  that  readers  are  familiar  with  the  field  of  navigation  so  certain 
topics  are  discussed  without  an  in-depth  background  tutorial,  i.e.,  Kalman  filters, 
Inertial  Navigation  Systems,  Global  Positioning  System,  etc.  The  reader  is  directed 
to  references  [6],  [7],  [14],  and  [18]  for  a  more  in-depth  review  of  the  material  presented 
here. 

Images  are  assumed  to  be  planar.  No  attempt  is  made  to  compensate  for 
altitude  changes  in  scene  objects  or  local  changes  in  the  earth’s  surface.  These 
simplifications  will  inject  some  error  into  the  process  of  generating  measurements 
with  a  camera. 

1.7  Materials  and  Equipment 

1.7.1  Air  Force  Flight  Test  Center.  The  Air  Force  Flight  Test  Center 
(AFFTC)  provided  a  many  resources  for  the  PEEPING  TALON  flight  test.  These 
resources  included:  range  airspace,  T-38  aircraft,  aircraft  modification  engineering 
support,  maintenance  equipment  and  maintenance  personnel. 

1.7.2  Matlab©.  Matlab©was  used  at  AFIT  to  design  the  Kalman  filter 
[5].  This  was  due  to  familiarity  with  the  software  since  much  of  the  curriculum  at 
AFIT  involved  the  use  of  this  particular  software  package.  It  was  also  used  after 
TPS  for  further  algorithm  development  and  data  analysis  [4], 
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Figure  1.1  PEEPING  TALON  T-38 

1.7.3  T-38  A  Aircraft.  A  T-38A  aircraft,  tail  number  65-10325,  was  mod¬ 
ified  to  support  the  PEEPING  TALON  test  program.  The  test  system  included 
navigation,  video,  and  recording  components.  It  consisted  of  a  GPS-Aided  Iner¬ 
tial  Navigation  Reference  system  (GAINR),  an  Ashtech  GPS  receiver,  two  model 
71A  video  cameras,  a  liquid  crystal  display  (LCD)  cockpit  monitor,  and  a  digital 
recording  system. 

1.7.4  GAINR.  The  GAINR  system  consisted  of  an  Embedded  GPS/INS 
(EGI),  a  Pre-Flight  Panel  (PFP),  a  Cockpit  Control  Panel  (CCP),  and  an  Intelligent 
Flash-memory  Solid  State  Recorder  (IFSSR).  The  GAINR  recorded  raw  Inertial 


1-13 


Measurement  Unit  (IMU)  data  (Av  and  A 6)  at  a  256  Hz  rate  and  a  blended  EGI 
position  solution  at  a  64  Hz  rate  to  an  internal  data  card. 

1.7.5  Ashtech  GPS  Receiver.  The  Ashtech  Z-Snrveyor  was  a  12-channel, 
dual  frequency  GPS  receiver  with  a  built-in  battery  and  removable  PC  memory  card. 
This  receiver  was  capable  of  providing  raw  GPS  signal  data  on  the  internal  data  card 
for  post-processing.  These  data  were  stored  at  a  2  Hz  rate.  A  second  Ashtech  GPS 
receiver  was  used  to  collect  stationary  data  for  differential  GPS  data  purposes. 

1.7.6  Camera.  Both  the  forward  and  side  cameras  were  Model  71 A  Ball 
Aerospace  cameras.  They  were  ruggedized  all  light  level,  high-performance,  Gated 
Intensified  Charge  Coupled  Device  monochrome  cameras.  These  cameras  used  a  3rd 
generation  intensifier  coupled  to  a  768  (H)  x  484  (V)  pixel  interline  charge  coupled 
device  image  sensor.  The  analog  video  output  contained  525  lines  at  a  field  rate  of 
60  Hz,  a  frame  rate  of  30  Hz,  and  with  2:1  positive  interlace.  The  cameras  operated 
from  28  volts  direct  current  with  a  power  consumption  of  less  than  6  watts.  Camera 
dimensions  were  5  x  2.5  x  2  inches  (L  x  H  x  W),  and  each  weighed  1.1  pounds. 

1.7.7  Camera  Lenses.  The  collection  of  lenses  used  had  three  different 
ficlds-of-view.  These  were  standard  type  video  camera  lenses,  in  that  they  were  not 
optimized  for  night  video  even  though  the  PEEPING  TALON  test  collected  video 
under  low-light  conditions  using  low-light  cameras.  The  airborne  video  recorder  was 
a  Sony  Digital  Video  Cassette  Recorder,  model  GV-D300. 

1.7.8  Video  Tapes.  The  tapes  used  in  the  airborne  video  recorder  were 
Panasonic  mini-DV  ME  80/120  cassettes.  Recording  was  performed  in  the  SP  record 
mode  as  this  was  the  highest  image  resolution  mode. 

1.7.9  Time  Code  Generator/Inserter.  The  GPS  time  code  generator,  Da¬ 
tum  model  9390-3000,  received  the  GPS  signal  from  the  externally  mounted  GPS 


1-14 


antenna  and  converted  it  to  a  digital  format  for  the  video  time  code  inserter.  The 
video  time  code  inserter,  Datum  model  9559-835,  received  GPS  data  from  the  GPS 
time  code  generator  and  the  video  signal  from  the  selected  camera.  The  video  time 
code  inserter  combined  these  two  data  streams  to  provide  a  single  output,  which  was 
a  video  picture  with  GPS  time  in  the  bottom  right  hand  corner  of  the  video  image. 
This  enabled  the  test  team  to  determine  the  precise  GPS  time  when  each  frame  of 
video  was  recorded. 

1.7.10  Video  Monitor.  The  video  monitor  for  the  front  seat  was  a  5-in. 
Transvideo  International  Rainbow  II  LCD  Monitor.  The  monitor  was  mounted  on 
the  front  cockpit  glare  shield,  and  was  rotated  right  approximately  40  degrees  (in  a 
clockwise  direction).  The  video  selector  switch  located  in  the  front  cockpit  controlled 
which  camera  was  displayed  on  the  monitor  and  recorded  on  the  video  recorder. 

1 . 8  Summary 

The  previous  was  a  broad  overview  of  the  work  contained  in  the  thesis  ef¬ 
fort  and  the  flight  test  to  collect  the  data.  Basic  navigation  and  aiding  concepts 
were  presented  along  with  the  problem  at  hand  and  the  strategy  for  solving  the 
problem.  Where  this  thesis  fits  into  the  overall  AFIT  and  TPS  education  programs 
was  discussed,  as  well  as  a  short  literature  review,  project  assumptions,  and  mate¬ 
rial/equipment  intended  for  use  in  solving  the  problem.  The  groundwork  is  now  in 
place  to  begin  with  project  specifics  beginning  with  Chapter  2,  Background  Theory. 
The  specific  design  of  the  visual  measurements  are  presented  in  Chapter  3.  Chap¬ 
ter  4  covers  the  results  obtained  during  the  research  as  well  as  an  analysis  of  those 
results.  Chapter  5  wraps  up  the  research  and  lays  out  follow-on  work  that  could  be 
accomplished.  Appendix  A  covers  the  actual  flight  test  that  occurred  at  USAF  Test 
Pilot  School. 
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2.  Background  Theory 


2. 1  Overview 

This  chapter  covers  theory  that  is  referenced  in  Chapter  3.  Kalman  filter 
basics  are  covered  briefly,  along  with  geometry  relating  to  the  shape  of  the  Earth, 
the  arc  length  equation,  other  necessary  geometry  equations,  and  a  description  of  the 
technique  used  to  generate  the  flight  profile  for  the  navigation  orbit.  The  notation 
used  throughout  this  work  that  pertains  to  the  Kalman  filter  is  taken  from  the  three- 
course  Stochastic  Estimation  and  Control  sequence  at  AFIT  which  uses  the  texts 
written  by  Dr  Peter  Maybeck.  Vectors  are  bolded  lower-case  while  matrices  are 
bolded  upper-case  [6,  7]. 

2.2  Kalman  Filter  Basics 

2.2.1  Kalman  Filter.  A  Kalman  filter  takes  a  dynamic  model  of  the  sys¬ 
tem,  measurements,  deterministic  inputs,  and  adds  in  statistical  descriptions  of  the 
uncertainties  in  each  of  these  and  blends  them  together  with  real-world  data  to  gen¬ 
erate  the  best  possible  estimate  of  certain  variables  of  interest.  Linear  Kalman  filter 
equations  are  used  and  presented  below  with  a  brief  explanation.  This  research  en¬ 
counters  some  nonlinearities  in  the  measurements,  and  the  method  of  dealing  with 
this  problem  is  also  presented.  Refer  to  [6,  7,  17]  for  a  more  lengthy  derivation  of 
Kalman  filters. 

2.2.2  Kalman  Filter  Equations.  The  system  model  in  this  research  is  a 

linear,  time-invariant,  discrete  time  system  in  the  form  of  Equation  (2.1),  where 
x(C)  is  an  (n  x  1)  state  process  vector,  is  an  (n  x  n)  system  transition 

matrix,  Gd(ti~i)  is  an  (n  x  s)  noise  input  matrix,  and  w d{ti-i)  is  an  (s  x  1)  white 
Gaussian  noise  vector  [3:2-2], 

x(ti)  =  i)x(L_i)  +  Gd(^_i)wd(fj_i)  (2.1) 
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The  discrete-time  dynamics  driving  noise  vector  wd(ij_i)  is  assumed  to  be  white, 
Gaussian,  with  a  mean  and  covariance  described  by  [3:2-3]: 


E[wd(ti)]  =  0 


(2.2) 


£[wd(*i)w£(tj)]  =  ^ 


Qd  for  U  =  tj 
0  for  ti  7^  tj 


(2.3) 


Nonlinear  measurements  are  available  and  are  modelled  by  Equation  (2.4),  where 
z (tj)  is  an  (nr  x  1)  measurement  vector,  h[x(tj),£j]  is  an  (m  x  1)  nonlinear  measure¬ 
ment  model  vector,  and  v(f*)  is  an  (m  x  1)  white  Gaussian  measurement  noise  vector 
[3:2-6] 

z  (U)  =  h  [xfo),  ti]  +  v(G)  (2.4) 


The  discrete-time  noise  vector  v(fj)  is  assumed  to  be  white,  Gaussian,  with  a  mean 
and  covariance  described  by  [3:2-6]: 


E[v(U)]  =  0 


(2.5) 


#[v(fi)vT(*j)]  =  < 


R(b)  for  ti  =  tj 
0  for  tj  7^  tj 


(2.6) 


Kalman  filter  equations  can  be  broken  up  into  three  major  categories:  initial  condi¬ 
tion  information,  filter  propagation,  and  filter  update.  Equations  for  each  of  these 
categories  are  presented  below. 


2.2.2. 1  Kalman  Filter  Initial  Condition  Equations.  Equation  (2.7) 
provides  the  best  information  available  about  each  of  the  states  at  the  beginning  of 
filter  operation  [6:217],  while  Equation  (2.8)  describes  the  initial  covariance  matrix, 
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which  provides  the  best  information  available  about  the  uncertainty  in  each  of  the 
states  at  the  beginning  of  filter  operation  [6:217]. 

x(t0)  =  £{x(f0)}  =  x0  (2.7) 

P(to)  =  E{[x(t0)  -  :xo][x(t0)  -  x0]T}  =  P0  (2.8) 

2. 2. 2. 2  Kalman  Filter  Propagation  Equations.  Equation  (2.9)  is  used 
to  propagate  the  states  forward  in  time  from  the  initial  conditions  or  the  last  mea¬ 
surement  update,  whichever  is  the  case.  This  continues  until  a  measurement  is 
available  for  incorporation  into  the  Kalman  filter  [3:2-4], 

x(f“)  =  $CMi-i)x(t+  J  (2.9) 

Equation  (2.10)  is  used  to  propagate  the  state  covariance  forward  in  time  from 
the  initial  conditions  or  the  last  measurement  update,  whichever  is  the  case.  This 
continues  until  a  measurement  is  available  for  incorporation  into  the  Kalman  hlter 
[3:2-4], 

P(*D  =  ^{ti,ti-i)P{tj_l)^T  {t.uti^i)  +  Gd(ti_i)Qd(ti_i)Gd(ii-i)  (2.10) 
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2. 2. 2. 3  Kalman  Filter  Update  Equations.  The  Kalman  filter  gain 
equation  (Equation  (2.11))  is  used  to  weight  a  measurement  for  incorporation  into  the 
Kalman  filter.  The  relative  uncertainty  between  the  optimal  estimates  of  what  the 
states  should  be  and  the  actual  measurements  determines  their  respective  weighting 
[6:259], 

K(n)  =  P(tr)Hr[ti,x((-)][H[f1,x((-)]P(f-)Hr[t1,x(t-)]  +  R(i.)]-'  (2.11) 


where  the  H[ti,x(ti  )]  matrix  is  generated  by  [3:2-10]: 


H[b:,  x(tj  )[ 


dh  [x,tj 


<9x 


x=x(q  ) 


(2.12) 


The  state  update  Equation  (2.13)  is  used  to  update  each  of  the  states  whenever  a 
measurement  is  available  [3:2-10],  while  Equation  (2.14)  is  used  to  update  the  state 
covariance  matrix  each  time  a  measurement  is  available  [3:2-10]. 


x(«,+)  =  x(ij  )  +K(t,)[z,  -  h[x(lj  ),  if]]  (2.13) 


p (C)  =  P (<r)  -  K((,;)H[«,;,x((.-)]P((-)  (2.14) 

2.2.3  Extended  Kalman  Filter.  An  Extended  Kalman  Filter  (EKF)  incor¬ 
porates  nonlinearities  in  the  system  model,  the  measurements,  or  both,  and  is  an 
extension  of  the  aforementioned  Kalman  filter  (hence  the  name).  The  basic  idea  is 
to  linearize  the  nonlinear  measurements,  or  dynamics  models,  about  a  redeclared 
nominal  trajectory  or  point  at  certain  intervals  so  linear  Kalman  filter  concepts  can 
be  used.  This  is  valid  if  the  nonlinearity  is  not  too  great  and/or  if  linearization  errors 
remain  small  [7:41], 

As  stated  previously,  Kalman  filters  work  best  when  using  raw  measurements 
as  opposed  to  measurements  that  are  pre-processed.  Pre-processing  measurements 
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creates  time-correlation  in  the  measurement  noises,  and  this  must  be  resolved.  One 
way  to  deal  with  this  problem  is  to  incorporate  measurements  with  enough  time  lapse 
between  epochs  that  the  assorted  measurement  noises  are  no  longer  time-correlated. 
Another  method  is  to  model  the  time-correlated  noise  with  a  linear  system  driven  by 
white  Gaussian  noise  [6:183].  Otherwise,  one  of  the  basic  Kalman  filter  assumptions 
is  violated,  i.e.,  a  linear  system  driven  by  white  Gaussian  noise  [6:8]. 

2.2.4  State  Vector.  A  Kalman  filter  is  used  to  estimate  variables  of  interest. 
These  variables  are  contained  in  the  (n  x  1)  dimension  state  vector  (x)  where  the 
caret  symbol  is  called  a  “hat”  and  indicates  the  variable  under  the  symbol  is  an 
estimate  and  not  the  actual  value.  Therefore,  the  state  vector  x  is  an  estimate  of 
the  actual  state  vector  x.  The  “n”  in  the  (n  x  1)  referenced  above  is  the  number  of 
states  being  estimated.  The  state  vector  may  be  the  actual  variables  of  interest  (a 
direct,  or  total  state  filter).  These  actual  variables  might  be  position  and  velocity  of 
a  vehicle.  For  an  error  state  (or  indirect)  filter,  the  errors  in  the  actual  variables  of 
interest  are  estimated.  These  might  be  the  error  in  position  and  velocity  of  a  vehicle 
[6:294],  Navigation  Kalman  filters  typically  use  an  error  state  implementation  due 
to  the  high  dynamic  rates  possible  in  aviation  systems.  These  high  dynamic  rates 
would  require  a  very  high  sample  rate  for  a  direct  state  filter.  However,  the  errors  in 
this  type  of  system  grow  slowly  and  this  allows  an  error  state  implementation  and  a 
much  lower  sample  rate  [6:291-297]. 
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The  twelve  states  implemented  in  this  research  are  as  follows: 


51  on 

Longitude  Position  Error  Estimate  (radians) 

Slat 

Latitude  Position  Error  Estimate  (radians) 

Salt 

Altitude  Position  Error  Estimate  (meters) 

Svn 

North  Velocity  Error  Estimate  (m/sec) 

Sve 

East  Velocity  Error  Estimate  (m/sec) 

Svd 

Down  Velocity  Error  Estimate  (m/sec) 

5a 

North  Axis  Tilt  Error  Estimate  (radians) 

5(3 

East  Axis  Tilt  Error  Estimate  (radians) 

5 7 

Down  Axis  Tilt  Error  Estimate  (radians) 

Shbaro 

Time-correlated  Barometric  Error  Estimate  (meters) 

Scb 

GPS  Clock  Bias  Error  Estimate  (meters) 

1 

O 

GPS  Clock  Drift  Error  Estimate  (m/sec) 

i_  _ii_  _i 

(2.15) 

An  estimate  of  the  total  state  xtrue  can  be  found  from  the  error  states  and  INS  data 
available  in  the  filter  by  correcting  the  INS  data  (States  1-9)  via  Equation  (2.16): 

X true  Xm.s  Sx  (2.16) 


where: 

xtrUe  is  the  corrected  state  value 
xins  is  the  INS  calculated  state  value 
Sx  is  the  filter  calculated  state  error  value 

2.2.5  State  Covariance  Matrix.  The  (n  x  n)  dimension  covariance  matrix 
(P)  is  an  estimate  generated  by  the  filter  that  provides  a  measure  of  filter  perfor¬ 
mance.  It  is  a  statistical  measure  of  the  uncertainty  in  each  of  the  states  [17:73]. 
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2.2.6  Dynamics  Driving  Noise  Covariance  Matrix.  (Q d)  is  an  (s  x  s) 

dimension  dynamics  driving  noise  covariance  matrix.  Qd  is  a  measure  of  the  strength 
of  the  dynamics  driving  noise  [8:252], 

2.2.7  State  Transition  Matrix.  The  state  transition  matrix  (<l>)  is  an  (n 
x  n)  dimension  matrix.  $  is  used  to  propagate  the  states  forward  in  time  using 
knowledge  about  how  the  system  functions  over  time  without  external  aiding. 

2.2.8  Measurement  Matrices.  There  is  a  measurement  vector  and  a  mea¬ 
surement  matrix  generated  in  this  filter.  The  first  is  the  nonlinear  measurement 
vector  function  (h(x)),  and  the  second  is  the  (H)  matrix,  which  is  a  linearized  ver¬ 
sion  of  the  first.  The  h(x)  vector  is  used  to  generate  the  filter  residuals  [6:218].  The 
residuals  are  the  difference  between  the  measurements  and  the  filter  predictions  of 
those  measurements.  The  residuals  provide  information  about  the  accuracy  in  the 
measurements. 

2.2.9  Measurement  Noise.  The  measurement  noise  covariance  matrix  (R) 
represents  the  uncertainty  introduced  in  the  measurement  process  clue  to  imperfect 
sensors,  noise,  etc.  The  R  matrix  has  the  same  number  of  elements  as  there  are 
measurements. 

2.2.10  Kalman  Filter  Cycle.  A  Kalman  filter  can  use  two  different  tech¬ 
niques  during  a  filter  cycle — propagation  and  update.  Propagation  refers  to  using 
the  system  dynamic  equations  to  move  the  states  and  covariance  forward  over  time, 
and  update  refers  to  using  measurements  to  increase  the  accuracy  of  those  same 
states  and  covariance  at  a  specific  instant  in  time.  A  cycle  does  not  require  that  an 
update  occur.  If  no  measurements  are  available,  the  states  continue  to  propagate 
forward  using  the  system  dynamic  equations.  This  is,  in  fact,  commonly  the  case 
in  a  navigation  filter.  Vehicle  PVA  are  computed  many  times  per  second,  while  up¬ 
dates  are  typically  incorporated  once  or  twice  a  second  (and  sometimes  much  less 
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time 


t%— i 


U 


Figure  2.1  Kalman  Filter  Cycle 

frequently  than  that).  If  measurement  incorporation  once  per  minute  produces  ac¬ 
ceptable  navigation  performance,  then  a  much  faster  update  rate  may  be  abandoned 
to  reduce  unnecessary  computational  loading. 

Figure  2.1  shows  a  typical  Kalman  filter  cycle  [6:207].  There  are  two  different 
time  epochs  shown  (fj_x  is  an  arbitrary  epoch  and  t,t  is  one  epoch  later).  The  state 
is  represented  at  different  times  by  the  hllcd-in  circles.  The  superscript  -  and  + 
represent  the  time  just  before,  and  just  after,  a  measurement  update,  respectively. 
The  circle  at  represents  the  state  just  after  an  update  is  performed  at  time  £*_ i. 
The  state  is  then  propagated  via  the  system  dynamic  equations  to  time  fj,  and  is 
represented  by  t~  indicating  the  state  immediately  prior  to  update  incorporation.  As 
before,  the  state  at  tf  represents  the  state  just  after  an  update  is  performed  at  time 
tj.  This  represents  only  one  cycle;  in  reality  this  process  is  repeated  many  times,  but 
the  underlying  concept  remains  unchanged. 
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2.3  Arc  Length  Equation 


The  arc  length  equation  is  used  repeatedly  during  this  research.  This  equation 
states  that  the  length  of  an  arc  (on  a  circle)  can  be  found  by  multiplying  the  radius 
by  the  angle  (in  radians).  The  radius  used  here  is  either  the  transverse  radius  of 
curvature  (Re)  or  the  meridian  radius  of  curvature  (Rn)  [16:305-306]. 

arc  length  =  rO  (2-17) 


where: 
r  =  radius 

6  =  angle  (in  radians) 


2.3.1  Meridian  Radius  of  Curvature.  The  meridian  radius  of  curvature 
(Rn)  is  used  to  determine  the  approximate  radius  of  the  Earth  at  the  given  latitude 
for  a  line  of  constant  longitude  [18:54]: 


R 


n 


R(  1-e2) 

[1  —  e2sin2{L)]i 


(2.18) 


where: 

R  =  Earth’s  radius  at  the  equator 
e  =  Earth’s  ellipticity 
L  =  Aircraft  Latitude 
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2.3.2  Transverse  Radius  of  Curvature.  The  transverse  radius  of  curvature 
(Re)  is  used  to  determine  an  equivalent  Earth  radius  at  a  given  line  of  constant 
latitude  [18:54]: 

Rcos(L) 

[1  —  e2sin2(L )]s 

where: 

R  =  Earth’s  radius  at  the  equator 
e  =  Earth’s  ellipticity 
L  =  Aircraft  Latitude 

The  distance  generated  by  using  Re  in  conjunction  with  the  arc  length  equation 
does  not  change  when  a  change  occurs  in  latitude.  However,  the  conversion  from 
distance  to  longitudinal  angle  (degrees  or  radians)  does  change  when  a  change  occurs 
in  latitude.  This  is  due  to  lines  of  longitude  converging  together  as  they  move  away 
from  the  equator.  This  explains  the  cos(L)  term  in  the  numerator  of  Equation  (2.19). 

2-4  Geometry 

Both  tangent  and  inverse  tangent  functions  are  used  repeatedly  in  this  research. 
The  partial  derivative  of  the  inverse  tangent  will  also  be  required,  and  for  this  reason 
it  will  be  reviewed  below. 

2.4.1  Derivative  of  Inverse  Tangent  Function.  The  partial  derivative  of  an 
inverse  tangent  function  is  not  a  trivial  calculation.  However,  it  will  be  needed  to 
generate  the  visual  measurement  H  matrix,  and  therefore  it  will  be  demonstrated 
below.  The  lower  case  variables  a,  b,  and  c  are  all  functions  of  at  least  one  of 
the  states.  In  this  formulation,  the  variable  c  represents  the  measurement  to  be 
incorporated,  the  variable  a  represents  distance,  and  the  variable  b  represents  another 
distance. 

c  =  tan-1  (^j  (2.20) 
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Taking  the  tangent  of  both  sides  of  the  equation  eliminates  the  arctangent  function 
and  simplifies  the  right  side  of  the  equation. 


tan(c)  =  tan 


tan 


-l 


b)  \ 


(2.21) 


Then  take  the  partial  derivative  of  both  sides  of  the  equation  with  respect  to  the 
states  (x). 


d_ 

dx 


tan(c ) 


d_ 

dx 


(2.22) 


Expanding  the  left  hand  side  of  Equation  (2.22)  removes  the  tangent  function  from 
the  partial  derivative  which  simplifies  the  equation  and  sets  the  equation  up  for  a 
substitution  in  the  next  step: 


d_ 

dx 


tan(c ) 


(1  +  tan2(c )) 


dc 

dx 


d  / a 
dx  \b 


(2.23) 


Recalling  from  Equation  (2.21)  that  tan(c)  =  |,  this  value  is  substituted  into  Equa¬ 
tion  (2.23),  to  simplify  the  left  hand  side  by  further  removing  the  tangent  function: 


1  + 


dc 

dx 


dc 

dx 


d  /a 
dx  \b 


(2.24) 


Then,  solve  for  the  partial  derivative  of 


dc 

-  b2  ' 

d  /  a  \ 

dx 

a2  +  b2 

dx\b) 

(2.25) 


Finally,  after  expanding  the  partial  derivative  portion  on  the  right  of  Equation  (2.25) 
and  cancelling  the  appropriate  terms,  the  final  form  for  is  obtained: 

dc 
dx 


a2  +  b2 


(i)  W  -  («)  (I )  _  (i )  W  -  (a)  (i) 


b2 


+  b2 


(2.26) 
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2.5  Navigation  Orbit  Geometry  Determination 

The  navigation  orbit  was  designed  so  that  a  particular  target  area  would  be 
within  the  camera  FOV  continuously  for  a  ten  minute  period.  A  circular  orbit  was 
used  in  an  effort  to  make  this  as  easy  as  possible  for  the  pilot. 

2.5.1  Assumptions.  There  were  several  simplifying  assumptions  made: 

1.  No  wind.  This  was  so  simple  geometric  equations  could  be  used  to  determine 
an  approximate  airspeed  and  orbit  size  for  the  navigation  orbit. 

2.  A  side-mounted  camera  points  out  the  right  side  of  the  aircraft.  Assuming  it 
points  down  the  right  wing  line  is  an  approximation  since  the  camera-to-body 
frame  rotation  is  not  known.  This  approximation  is  accurate  enough  for  flying 
the  navigation  orbit  since  the  pilot  will  not  be  able  to  fly  the  exact  profile. 

The  first  assumption  caused  some  difficulties  while  the  second  did  not.  The 
difficulties  encountered  will  be  addressed  later  in  the  “lessons  learned”  section  in  the 
appendices. 

2. 6  Summary 

This  chapter  covered  some  basic  theory  that  is  needed  in  Chapter  3.  Kalman 
filter  basics  were  covered  briefly,  along  with  geometry  relating  to  the  arc  length  equa¬ 
tion  and  other  necessary  geometric  relationships.  A  description  of  the  assumptions 
pertaining  to  the  flight  profile  for  the  navigation  orbit  was  also  presented. 
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3.  Methodology 


3. 1  Overview 

The  thrust  of  this  research  is  the  incorporation  of  a  new  type  of  visual  mea¬ 
surement  into  a  navigation  Kalman  filter.  This  measurement  is  formulated  in  two 
parts,  each  of  which  is  an  angle.  The  measurements  as  implemented  in  this  research 
were  simulated;  however,  a  method  for  generating  the  measurements  using  a  camera 
is  presented  at  the  end  of  this  chapter.  The  chapter  is  broken  up  into  five  major 
parts:  3.2)  Visual  Measurements,  3.3)  Visual  Measurement  Generation,  3.4)  Visual 
Measurement  Error  Estimation,  3.5)  Visual  Measurement  Generation  using  a  Cam¬ 
era,  and  3.6  Estimation  of  Attitude  Error  States.  These  last  two  sections  extend  the 
research  to  using  an  actual  camera,  even  though  one  was  not  implemented  in  this 
thesis. 

3.2  Visual  Measurements 

Each  visual  measurement  is  made  up  of  two  different  parts  —  azimuth  and 
elevation  angles.  These  angles  are  measured  from  the  aircraft  to  the  target  relative 
to  the  North  -  East  -  Down  (NED)  navigation  frame.  The  angles  used  here  are 
referenced  from  the  Down  vector  and  not  out  the  nose  of  the  aircraft  (the  way 
azimuth  and  elevation  are  typically  referred  to  in  an  Air-to-Air  radar).  This  means 
a  point  on  the  ground  directly  under  the  aircraft  would  be  0  degrees  elevation  and 
0  degrees  azimuth.  Elevation  and  azimuth  angles  increase  from  0  as  the  point  of 
interest  moves  away  from  a  point  directly  under  the  aircraft.  The  sense  for  these 
measurements  is  listed  in  Table  3.1. 

The  previously  mentioned  NED  navigation  frame  is  a  local-level  frame.  As 
defined  for  the  NED  frame,  elevation  is  along  a  line  of  constant  longitude  and  azimuth 
is  along  a  line  of  constant  latitude.  Aircraft  altitude  is  known,  and  target  altitude  is 
assumed  known.  This  assumption  is  considered  reasonable  in  light  of  digital  terrain 
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Ta 


bic  3.1  NED  Frame  Elevation  and  Azimuth  Sense 


Target  Direction  from 
Aircraft  in  NED  Frame 

Elevation 

Azimuth 

North 

+ 

n/a 

South 

- 

n/a 

East 

n/a 

+ 

West 

n/a 

- 

elevation  data  (DTED)  being  readily  available.  This  information  is  not  incorporated 
into  this  research,  but  the  data  is  available  and  could  be  included  at  a  later  date. 


3.3  Visual  Measurement  Generation 

The  visual  measurements  are  formed  according  to  the  geometry  between  the 
aircraft  and  the  location  of  the  selected  target.  The  visual  measurements  were  gen¬ 
erated  in  the  manner  described  below. 

At  visual  measurement  incorporation  time,  a  vector  was  formed  from  the  air¬ 
craft  location  to  a  known  target  location,  expressed  in  the  NED  frame.  This  known 
target  location  was  used  with,  and  without,  errors  being  injected  in  the  target  loca¬ 
tion  (by  adding  errors  into  the  stored  angle  values  as  they  are  used).  Aircraft  and 
target  latitude,  longitude  and  altitude  were  used  to  form  this  vector.  No  error  is 
shown  for  tgtiat ,  tgtion,  or  tgtait.  It  is  acknowledged  that  there  would  be  errors  in 
these  values,  but  this  added  complexity  is  not  dealt  with  in  this  formulation.  See 
Chapter  5  for  recommendations  extending  the  research  in  this  area. 

The  difference  between  the  target  latitude  and  the  latitude  of  the  aircraft  (in 
radians)  is  calculated  by: 


A/nf  tgtiat  o>cftiat  Slat 


(3.1) 


where: 

A lat  is  the  difference  between  aircraft  and  target  latitude  (radians) 
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tgtiat  is  the  target  latitude  (radians) 

acftiot  is  the  aircraft  INS-reported  latitude  (radians) 

Slat  is  the  filter-estimated  aircraft  latitude  error  (radians) 

(acftua  +  Slat )  is  the  best  estimate  of  the  true  latitude  of  the  aircraft 

Next,  the  distance  correlating  to  the  A lat  from  the  previous  step  is  calculated  using 
the  arc  length  equation,  with  a  radius  defined  by  Equation  (2.18).  This  will  then 
be  the  distance  from  the  aircraft  to  the  target  projected  along  a  line  of  constant 
longitude.  This  projected  distance  is  the  North  component  of  a  vector  from  the 
aircraft  to  the  target  in  the  NED  frame. 

c Idist  RnAlat  Rn(tc/tiat  acftiat  Slat )  (3.2) 

The  difference  between  the  target  longitude  and  the  longitude  of  the  aircraft  (in 
radians)  is  calculated  by: 


A  Ion 


tfjtion  acftion  SloYl 


(3.3) 


where: 

A  Ion  is  the  difference  between  aircraft  and  target  longitude  (radians) 

tgtion  is  the  target  longitude  (radians) 

acftion  is  the  aircraft  INS-reported  longitude  (radians) 

Sion  is  the  filter-estimated  aircraft  longitude  error  (radians) 

( acftion  +  Sion )  is  the  best  estimate  of  the  true  longitude  of  the  aircraft 

Finally,  the  distance  correlating  to  the  A  Ion  from  the  previous  step  is  determined 
using  the  arc  length  equation.  This  is  the  distance  from  the  aircraft  to  the  target 
projected  along  a  line  of  constant  latitude.  This  projected  distance  is  the  East 
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component  of  a  vector  from  the  aircraft  to  the  target  in  the  NED  frame. 

dZdist  Re/\lOTl  Rei^Q^lon  CLCftl  on  Sion )  (3.4) 

The  difference  between  the  target  altitude  and  the  altitude  of  the  aircraft  is  calculated 
slightly  differently  in  keeping  with  the  sign  convention  listed  in  Table  3.1  for  the 
North  and  East  directions  in  the  NED  frame.  North  is  positive,  East  is  positive,  so 
according  to  the  right-hand  rule,  Down  is  positive.  This  calculation  is  given  by: 

0 1 1 (1 1st  dcflalt  “t“  Salt  tgtalt  (3.5) 

where: 

altdist  is  the  difference  between  aircraft  and  target  altitude  (meters) 
cicft ait  is  the  aircraft  INS-reported  altitude  (meters) 

Salt  is  the  filter-estimated  aircraft  altitude  error  (meters) 
tgtait  is  the  target  altitude  (meters) 

( acftait.  +  Salt )  is  the  best  estimate  of  the  true  altitude  of  the  aircraft 

The  aircraft-to-target  vector  in  the  NED  frame  is  formed  by  the  North,  East,  and 
Down  components  generated  in  the  previous  three  steps. 

RnAlat  Itn  (t  filial  tiai.  Slat ) 

ReAlon  =  Re(tgtlon  -  acftlon  -  Sion )  (3.6) 

dltdist  acftait  T  Salt  tgtalt 
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Finally,  the  NED  frame  vector  is  used  to  determine  the  elevation  and  azimuth  angles 
from  the  aircraft  to  the  target  via  Equations  (3.7)  and  Equations  (3.8): 


Elevation  =  tan  1  (  dlst  ^  (3.7) 

\  °ltdist  J 

Azimuth  =  tan-1  f  dlst  ^  (3.8) 

\altdist  J 

3.4  Visual  Measurement  Error  Estimation 

During  filter  operation,  simulated  measurements  and  filter  predictions  of  those 
same  measurements  are  differenced  and  used  as  measurements  in  the  filter.  The  filter 
predicts  the  measurements  by  taking  the  equations  used  to  generate  the  estimated 
measurements  to  form  the  h(x_)  vector.  The  nonlinear  h(-)  vector  is  then  used  to 
generate  the  linearized  H(x~)  matrix.  This  is  done  by  taking  the  partial  derivative 
of  h(-)  with  respect  to  each  state  in  the  filter. 


3-4-1  Generating  the  H(x~)  Matrix.  The  first  row  of  the  H(x~)  matrix 
corresponds  with  the  azimuth  measurements,  while  the  second  row  corresponds  with 
the  elevation  measurements.  The  fully  populated  H(x_)  will  look  like  Figure  3.9. 


az  row 

daz 

dSlon 

0 

daz 

88  alt 

0 

0 

0 

0 

0 

0 

0 

0 

0 

el  row 

0 

del 
881  at 

del 

88  alt 

0 

0 

0 

0 

0 

0 

0 

0 

0 

Generation  of  the  first  element  of  the  azimuth  row  is  shown  below  in  Section 
3.4. 1.1.  Equation  (2.25)  is  repeated  here,  as  it  is  needed  to  generate  each  of  the  12 
components  of  the  H(x-)  matrix  first  row: 


dtan  1  (f)  =  (£)  ( b )  -  (°)  (§) 

dx  a 2  +  b2 


(3.10) 


3-5 


3. 4-1-1  Azimuth  Row  Generation.  The  right  side  of  Equation  (3.11) 
must  be  calculated  with  respect  to  each  of  the  twelve  states  in  the  Kalman  filter 
state  matrix.  The  end  result  for  azimuth  will  populate  row  1  of  Equation  (3.9).  The 
elements  that  are  zero  are  dne  to  the  partial  derivatives  all  being  zero.  This  is  due 
to  the  right  side  of  Equation  (3.11)  not  being  a  function  of  any  of  those  states. 

dtari _1  ai^lst 

First,  the - ^  jn dist  component  of  the  H(x  )  matrix  will  be  calculated  (element 

for  row  1,  column  1).  The  generic  equation  is  given  by  Equation  (3.11): 


8  tan 


-l 


a'zdist 

Q’tt'dist 


dciZdist 

dstatei 


{flit  dist)  ifl^dist) 


daltdist 

dstatei 


dstatej 


aZdist  +  altl 


(3.11) 


dist 


The  generic  equation  becomes  more  specific  when  the  partial  derivative  is  taken  with 
respect  to  a  particular  state: 

ft™-1  (as)  =  (Sr)  (°^>  -  («~)  (g&t) 

88  Ion  azdist  +  aM'Lt 


The  equation  is  then  best  broken  into  two  parts.  The  partial  derivative  on  the  left 
side  of  the  numerator  is  shown  here: 

^dlSt)  =  [Reitgtion  -  acftion  -  Sion )]  =  -Re  (3.13) 

8 51  on  J  85 Ion 

while  the  partial  derivative  on  the  right  side  of  the  numerator  is: 

daltdtsA  =  8  ^acftait  +  fiajt  _  tgtalt)  =  o  (3.14) 

85 Ion  J  8 51  on 
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The  results  of  the  two  partial  derivative  calculations  are  then  substituted  back  into 
Equation  3.12,  which  can  now  be  solved  in  this  more  simplistic  form: 


dtarT 1  ( 

y  a^dist 

35 1  on 


-Re)(acftait  +  Salt  -  tgtaU )  -  (Re[tgtion  -  acftion  -  5lon}){ 0) 

(Re[tgtion  -  acftion  -  Sion})2  +  ( acftaU  +  Salt  -  tgtau)2 

(3.15) 


which  reduces  to: 


3 tan'1  ( 

y  Q'l't'dist 

3  51  on 


Re(acftait  +  Salt  tgtait) 


(Re[tgtlon  -  acftion  ~  Sion])2  +  ( acftait  +  Salt  -  tgtauf 


(3.16) 


The  remaining  three  elements  from  Equation  3.9  are  calculated  in  a  like  man¬ 
ner,  and  the  results  are  shown  below.  Intermediate  calculations  are  omitted,  because 
they  are  similar  to  the  fan-1  f  aitff )  example  given  above. 


3  tan 


1  (  azdist 


alt 


'dist 


dSalt 


Reifgtion  acftion  Sion) 
( RJtati ™  —  acfti. 


2 


(3.17) 


3  51  at 


Rn(acftait  T  Salt  tgtau) 

(Rn[tgtiat  -  acftiat  -  Slat})2  +  ( acftaU  +  Salt  -  tgtaU)2 


(3.18) 


dtan  1  _ _ -Rnitgtiat  -  acftiat  -  Slat) _  _  1Q, 

3 Salt  ( Rn[tgtiat  -  acftiat  -  Slat])2  +  (. acftaU  +  Salt  -  tgtaU )2 

3.5  Visual  Measurement  Generation  using  a  Camera 

Section  3.5  is  not  actually  implemented  in  this  thesis.  It  is  presented  here  to 
support  follow-on  work. 
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3.5.1  Required  Camera  Specifications.  Certain  camera  specifications  are 
required  to  relate  camera  frame  geometry  to  navigation  frame  geometry.  Camera 
focal  length  (/)  must  be  known,  and  one  of  the  following  must  be  known  to  determine 
the  width  and  height  of  the  viewed  image.  This  information  is  used  to  determine 
the  vertical  and  horizontal  pixel  size. 


1.  Vertical  and  horizontal  field-of-view  ( few %  and  fovch  respectively),  where  the  v 
and  h  subscripts  are  for  vertical  and  horizontal,  respectively.  The  superscript 
c  indicates  the  variable  is  in  the  camera  frame. 

2.  If  the  fields-of-view  are  not  known,  vertical  and  horizontal  coverage  ( cov %  and 
covch  respectively)  can  be  used  to  generate  these  angles  by: 

fovcv  =  2  tan-1  (3.20) 

fovch  =  2  tan'1  (3-21) 

Then,  the  vertical  and  horizontal  pixel  size  can  be  calculated  by: 


pixelv 


covrv 

ver  pixel  count 


(3.22) 


,  covi 

pixelh  =  - ; — - -  (3. 

hor  pixel  count 

3.5.2  Generate  Target  Latitude/ Longitude.  The  camera  geometry  is  used 
to  translate  target  pixel  location  into  a  geometrical  reference.  This  can  then  be 
rotated  into  the  body  frame  and  ultimately  into  the  NED  navigation  frame. 

Targets  in  an  image  are  selected,  and  this  selection  generates  pixel  locations 
for  each  target.  These  pixel  locations  are  referenced  from  the  center  of  the  image. 
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This  vector  is  shown  in  Equation  (3.24). 


n  = 


nx 

ny 


vertical  component  of  target  in  pixels 
horizontal  component  of  target  in  pixels 


(3.24) 


The  camera  frame  sense  is  similar  to  that  previously  described  in  the  navigation 
frame.  This  camera  sense  is  shown  below  in  Table  3.2  and  is  echoed  in  Figure  3.1. 


Table  3.2  Camera  Frame  Elevation  and  Azimuth  Sense 


Target  Direction  from 
Center  of  Camera  Frame 

Elevation 

Azimuth 

Up 

+ 

n/a 

Down 

- 

n/a 

Right 

n/a 

+ 

Left 

n/a 

- 

North 


East 


Figure  3.1  Sign  Convention 


Vector  n  is  generated  in  a  fashion  similar  to  that  show  in  Figure  3.2,  and  can  then 
be  formed  into  a  3D  vector  in  the  camera  frame  by  multiplying  by  the  proper  pixel 
size  to  get  a  distance  in  the  camera  frame.  Knowledge  of  the  camera  focal  length 
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tare 
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1 
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1 

>-  Distance 
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Distance  aircraft 

1 

1 

1 

1 

_ 1 _ 

East 


Figure  3.2  Distances 

provides  the  third  dimension.  Equation  (3.5.2)  now  forms  a  vector  to  the  target(s) 
in  the  camera  frame.  This  is  captured  by  the  following  equation: 


(pixel  v)(nx) 

77  c 

,Lx 

nc  = 

(pixel  h)  (ny) 

= 

nl 

f 

f 

(3.25) 


Camera  errors  due  to  deficiencies  in  the  optics  must  now  be  removed  so  the  above 
vector  points  to  the  actual  target  location  as  opposed  to  the  skewed  location  shown 
on  the  photo.  The  camera  errors  generated  during  the  camera  calibration  procedure 
discussed  in  Section  3.5.7  are  stored  in  an  angular  format,  so  vector  nc  is  used  to 
generate  the  uncorrected  azimuth  ( azuncorr )  (Equation  (3.26))  and  the  uncorrected 
elevation  ( eluncorr )  (Equation  (3.27)).  Figure  3.3  graphically  demonstrates  these 
angles.  They  are  the  azimuth  and  elevation  angles  with  optical  errors  still  present. 
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Figure  3.3  Angles 


aZuncorr  =  t(m  1  (^j)  (3-26) 

duncorr  =  (jr')  (3-27) 


These  angles  will  become  azimuth  in  the  camera  frame  ( azc )  and  elevation  in  the 
camera  frame  (elc)  once  the  errors  are  removed  via  Equations  (3.28)  and  (3.29).  The 
values  for  the  optical  azimuth  error  (optical azerror)  and  the  optical  elevation  error 
(optical eierror)  are  pre-computed  during  the  camera  alignment  procedure  (see  Section 
3.5.7). 


azc 


az„ 


opticala 


elc 


el 


C 

uncorr 


Opt  1  Cdlfierror 


(3.28) 

(3.29) 


The  corrected  azc  and  elc  must  be  converted  back  to  a  vector  so  target  information 
can  be  rotated  from  the  camera  frame,  through  the  body  frame  (via  Equation  (3.31)), 
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to  the  navigation  frame  (via  Equation  (3.32)). 


( f)(tan(elc )) 

K 

nc  = 

(. f)(tan(azc )) 

/ 

— 

ny 

f 

(Vector  in  Camera  Frame) 

(3.30) 

This  is  accomplished  by  pre-multiplying  the  camera  frame  vector  by  the  camera-to- 
body  direction  cosine  matrix  (DCM)  (Cb)  in  Equation  (3.31): 

nb  =  Cbcnc  (Vector  in  Body  Frame)  (3.31) 


Then  the  body  frame  vector  is  pre-multiplicd  by  the  body-to-navigation  frame  DCM 
(C£)  to  transform  the  vector  into  the  navigation  frame: 

n”  =  C£n6  (Vector  in  Nav  Frame)  (3.32) 


The  azn  (Equation  (3.33))  and  eln  (Equation  (3.34))  angles  can  then  be  determined 
from  the  components  of  vector  nre.  These  angles  are  NED  frame  angles: 


azn  =  tan  1 


(3.33) 


eln  =  tan  1 


(3.34) 


The  next  step  is  to  determine  target  longitude  and  latitude.  Longitude  will  be 
calculated  by  first  determining  Earth  radius  ( Re )  along  a  line  of  constant  latitude  at 
the  current  aircraft  latitude.  Then  az11  is  used  to  determine  distance  along  a  line  of 
constant  latitude  ( azdist )  from  aircraft  longitude  to  target  longitude: 


azdist  =  ( altdist)tan(azn ) 


(3.35) 
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Then  the  arc  length  equation  is  used  to  determine  the  radian  change  in  longitude 
from  the  aircraft  to  the  target: 


A  Ion 


Q'Z'dist 

Re 


Target  longitude  can  then  be  calculated  by  the  relationship: 


tgtion  =  A  Ion  +  acftion  +  Sion 


(3.36) 


(3.37) 


A  similar  procedure  is  used  to  determine  target  latitude  by  first  determining  Earth 
radius  ( Rn )  along  a  line  of  constant  longitude  at  the  current  aircraft  latitude.  This 
is  analogous  with  Re  above,  except  the  change  in  latitude  is  along  a  line  of  constant 
longitude  which  is  an  ellipse  rather  than  a  circle.  Use  eln  to  determine  distance  along 
a  line  of  constant  longitude  ( eldist )  from  aircraft  latitude  to  target  latitude: 

eldist  =  ( altdiSt)tan(eln )  (3.38) 


eldist  is  then  combined  with  the  arc  length  equation  to  determine  the  radian  change 
in  latitude  from  the  aircraft  to  the  target: 

A  lot  =  (3.39) 

ltn 

Target  latitude  can  then  be  determined  by  the  relationship: 

tgtiat  =  A  lat  +  acftiat  +  Slat  (3.40) 

3.5.3  Generate  Measurements  from  an  Image.  The  procedure  for  generat¬ 
ing  measurements  from  an  image  is  exactly  the  same  as  in  Section  3.5.2,  steps  3.5.2 
through  3.5.2.  The  remaining  steps  in  Section  3.5.2  need  not  be  accomplished  to 
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generate  measurements  because  target  latitude/longitude  is  estimated  the  first  time 
the  target  was  incorporated. 

3.5.4  Generate  Measurement  Estimates.  The  procedure  for  estimating 
measurements  is  very  similar  to  that  of  Section  3.5.2,  except  the  procedure  is  per¬ 
formed  backwards.  First,  dzn  is  determined  from  the  estimate  of  target  longitude 
by  re-arranging  Equation  (3.37)  to  get  the  change  in  longitude  from  the  current  INS 
longitude  to  the  target  longitude: 

A  Ion  =  tgtion  -  acftion  -  Sion  (3.41) 

Then  Equation  (3.36)  is  re-arranged  to  get  the  estimated  azdist- 


ciZdist  7?eA  Ion  (3.42) 

Similarly,  eln  can  be  determined  from  the  estimate  of  target  latitude  by  re-arranging 
Equation  (3.40)  to  get  the  change  in  latitude  from  the  current  INS  latitude  to  the 
target  latitude: 

A  lot  =  tgtiat  ~  acftiat  -  Slat  (3.43) 

Then  Equation  (3.39)  is  manipulated  to  get  the  estimated  eldist- 

eldist  =  RnAlon  (3.44) 


The  previously  determined  azdist  and  eldist  can  be  combined  with  altitude  data  to 
form  the  vector  to  the  target  in  the  navigation  frame: 


RnAlat 

K 

ddist 

ReAlon 

= 

ny 

= 

azdist 

altitude 

ttltdist 

(3.45) 
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The  Cbn  DCM  is  used  to  rotate  the  navigation  frame  vector  to  the  body  frame: 


hb  =  Cbnhn  (3.46) 

Then  the  DCM  is  used  to  rotate  the  body  frame  vector  to  the  camera  frame: 

nc  =  Ccbhb  (3.47) 

/s  Q 

Determine  estimates  of  azc  and  el  in  camera  frame  from  the  components  of  the 
camera  frame  vector  nc: 


=  tan  1 

/  fC  \ 

azc 

1  J  1 

(3.48) 
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(3.49) 
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3.5.5  Camera-to-Body  DCM  Generation  .  The  camera-to-body  DCM  (C[!) 
is  generated  by  tracking  targets  with  surveyed  coordinates.  A  vector  to  the  target 
is  generated  in  the  camera  frame  and  a  vector  to  the  target  is  generated  in  the  nav 
frame.  The  nav  frame  vector  is  rotated  into  the  body  frame.  The  two  vectors  are 
now  related  through  Cj!. 

3.5.6  Visual  Measurement  R  Matrix  Generation.  Generating  the  uncer¬ 
tainty  in  a  measurement  is  somewhat  arbitrary.  It  should  be  based  on  sound  rea¬ 
soning  even  though  the  final  value  that  works  best  in  the  actual  filter  may  be  quite 
different.  This  value  is  typically  found  by  “tuning”  the  Kalman  filter.  This  is  a 
process  in  which  different  uncertainties  in  the  filter  are  adjusted  to  generate  the  best 
possible  filter  performance.  In  a  perfect  world  the  measurements  would  have  zero 
error.  However,  this  is  not  the  case  so  errors  that  exist  must  be  approximated.  This 
is  so  the  uncertainty  in  the  measurements  can  be  used  to  weight  the  measurements 
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properly.  The  following  phenomena  cause  errors  in  the  visual  measurements  and  will 
be  addressed  individually:  faulty  pixel  selection  and  optical  deficiencies. 

Faulty  pixel  selection  is  due  to  the  inability  to  select  the  exact  same  point  on  a 
target  each  time  that  target  is  used  to  generate  a  measurement.  An  error  of  several 
pixels  is  realistic  in  such  a  procedure.  This  error  will  inject  itself  directly  into  the 
measurements  as  an  angle  error.  The  vector  generated  in  Section  3.5.2,  Equation 
(3.24)  will  contain  this  error  and  inject  it  directly  into  Equations  (3.51)  and  (3.52). 
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(3.50) 


(3.51) 

(3.52) 


The  worst  case  angle  error  for  faulty  pixel  seleciton  occurs  when  the  selected 
pixel  location  is  supposed  to  be  in  the  exact  center  of  the  image  but  is  off  by  some 
error  amount.  A  typical  case  is  demonstrated  below  using  camera  specs  for  the  cam¬ 
era  in  use  during  algorithm  development  at  AF1T  (not  used  during  flight  test).  The 
uncorrected  true  azimuth  (az^ncorr.  uJ  and  uncorrected  true  elevation  (elcuncorr,  uJ 
are  each  zero  since  they  are  supposed  to  be  in  the  image  center.  Two  pixels  of  error 
is  assumed  as  a  nominal  case  and  0.0074mm  and  0.0073mm  are  the  pixel  sizes  for 
azimuth  and  elevation  pixels,  respectively: 
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The  errors  incurred  above  inject  directly  into  the  next  type  of  error,  which  are 
optical  deficiencies.  Optical  deficiencies  are  due  to  abnormalities  in  the  camera  lens, 
imperfections  in  camera  component  alignment,  software  resident  in  the  camera  as 
well  as  other  physical  camera  phenomenon.  A  calibration  procedure  is  performed  in 
Section  3.5.7,  but  this  cannot  remove  all  the  errors  present.  This  is  especially  true 
when  the  angles  generated  in  the  previous  section  have  errors  due  to  improper  pixel 
selection. 
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azc  =  az^rue  +  5az' 


(3.63) 

=  azlncorrtrue  +  5a Z°uncorr  +  OptErrx  (3.64) 

where  OptErrx  is  generated  from  the  optical  error  surface  determined  from  the 
camera  calibration  procedure  (i.e. ,  OptErr o  =  -0.00135  and  OptErr2  =  -0.00154). 
This  optical  error  must  estimated  since  it  cannot  be  solved  for  deterministically. 
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The  same  effect  occurs  for  errors  in  the  elevation  measurements.  These  values 
are  for  only  one  point  and  would  need  to  be  analyzed  for  the  entire  error  surface  to 
generate  a  more  accurate  characterization  of  the  errors.  This  analysis  could  be  used 
to  generate  an  appropriate  order  of  magnitude  for  the  l-cr  values  for  these  errors. 
This  l-cr  value  could  then  be  used  as  a  first  cut  at  an  R  value  for  the  filter. 

3.5.1  Camera  Calibration  Procedures.  The  camera  must  be  calibrated 
before  it  is  used  for  a  mission.  Errors  are  resident  that  must  be  removed.  This 
cannot  be  done  deterministically,  so  a  procedure  is  used  to  estimate  the  errors.  The 
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camera  is  set  up  a  known  distance  from  a  calibration  target  (similar  to  that  shown  in 
Figure  3.4).  The  camera  must  be  carefully  aligned  so  its  focal  plane  is  parallel  to  the 
target  or  errors  will  be  injected  into  the  final  result  since  this  will  skew  the  geometry 
between  the  camera  and  the  target.  A  mis-alignment  of  this  sort  essentially  changes 
the  physical  geometry  of  the  setup.  Since  this  error  is  not  detected  it  will  pollute 
the  error  surface  being  generated.  Then  a  picture  is  taken  of  the  calibration  target. 
This  picture  is  used  to  generate  the  azimuth  and  elevation  angles  to  each  element 
in  the  calibration  photo.  These  angles  are  then  compared  with  the  known  angles 
that  are  generated  from  the  known  physical  geometry  between  the  camera  and  the 
calibration  target.  The  azerror  and  elerror  are  defined  in  Equations  (3.71)  and  (3.72) 
respectively: 


CLZerror  true  d^meas 


(3.71) 


el 


error 


el 


true 


elr 


(3.72) 


These  azimuth  and  elevation  errors  generate  an  error  surface  for  the  entire 
camera  field-of-view.  The  azimuth  error  surface  generated  at  AF1T  during  develop¬ 
ment  is  shown  below  in  Figure  3.5.  This  figure  describes  the  error  in  azimuth  as  a 
function  of  horizontal  and  vertical  position  in  the  image.  The  surface  appears  as  a 
planar  image  due  to  the  sign  convention  described  previously.  The  elevation  error 
surface  is  similar  in  appearance. 
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Azimuth  Error  (radians) 


Azimuth  Error  due  to  Camera  Lens 


Figure  3.5  Azimuth  Error  Surface 
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3.6  Estimation  of  Attitude  Error  States 

The  method  for  estimating  the  attitude  error  states  presented  below  is  not 
actually  implemented  in  this  thesis.  It  is  presented  here  to  support  follow-on  work. 

This  section  is  similar  to  Section  3.4,  in  that  the  H(x_)  matrix  must  be  derived 
and  calculated.  However,  the  attitude  error  terms  must  also  be  populated  in  this 
matrix,  in  addition  to  the  four  terms  already  described. 

Recall  that  the  camera  frame  vector  nc  must  be  rotated  through  two  frames 
to  generate  n”: 

nc  =  C”Cy  (3.73) 


The  camera-to-body  frame  DCM  (C^)  is  a  fixed  DCM  in  this  research.  However, 
the  body-to-navigation  frame  DCM  (C^)  changes  every  epoch  and  contains  errors 
associated  with  three  of  the  states.  Those  states  are  North  axis  tilt  error  (5a),  East 
axis  tilt  error  ( 8(5 ),  and  Down  axis  tilt  error  (Sj).  This  means  the  partial  derivative 
of  the  measurements  with  respect  to  the  states  will  have  more  elements  that  are 
non-zero.  Those  elements  are  shown  in  Equation  (3.74)  with  the  first  three  columns 
being  the  same  as  presented  previously.  The  incorporation  of  a  camera  into  this 
research  will  certainly  cause  filter  performance  to  suffer  somewhat.  How  much  is 
to  be  determined.  However,  the  errors  should  be  small  enough,  at  least  initially, 
that  visual  measurements  still  generate  better  filter  performance.  The  point  where 
the  tilt  errors  grow  too  large  for  visual  measurements  to  be  effective  is  also  to  be 
determined. 
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The  actual  formulation  of  this  new  H(x  )  is  not  derived  here,  but  it  should  be  similar 
in  derivation  to  that  from  Section  3.4. 
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3. 7  Summary 

This  chapter  defined  the  visual  measurements  to  be  incorporated  into  the 
Kalman  filter  and  demonstrated  the  formulation  of  these  angles.  The  method  of 
generating  visual  measurement  errors  was  covered  in  detail,  as  well  as  the  theory  for 
incorporating  visual  measurements  from  an  actual  camera.  The  effects  of  the  simu¬ 
lated  measurements  as  implemented  in  this  thesis  are  analyzed  in  the  next  chapter. 
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4-  Results  and  Analysis 


4-1  Sortie  Overview 

Simulated  visual  measurements  were  generated  during  Kalman  filter  operation. 
Elevation  and  azimuth  angles  were  generated  at  a  2  Hz  rate  during  the  6-minute  27- 
second  navigation  portion  from  time  244995  to  time  245382  (GPS  week  seconds). 
This  was  accomplished  by  running  the  GPS  filter  (see  Table  4.1  for  an  explanation  of 
the  different  filter  types)  and  generating  azimuth  and  elevation  angles  at  each  image 
incorporation  time.  This  data  was  then  stored  in  a  data  hie  for  incorporation  into 
the  Kalman  filter  for  analysis. 

The  sortie  chosen  for  analysis  in  this  research  was  a  daylight  flight  from  Ed¬ 
wards  AFB  to  the  Channel  Islands  (off  the  coast  of  Los  Angeles)  and  back.  A 
navigation  orbit  was  performed  right  after  takeoff,  with  the  remainder  of  the  flight 
dedicated  to  the  camera  evaluation.  The  ground  track  for  the  sortie  is  shown  in 
Figure  4.1,  with  the  altitude  displayed  in  Figure  4.2.  These  figures  are  given  to 
demonstrate  the  sortie  profile  visually.  The  filter  data  shown  here  incorporated  GPS 
measurements  only,  and  no  baro  or  visual  measurements  were  used.  This  data  was 
saved  and  used  as  a  truth  source.  There  were  other  truth  sources  available  (i.e. , 
Ashtech-only,  EGI-only,  and  a  differential  GPS  solution).  The  Ashtech-only  and 
EGI-only  solutions  were  less  smooth  than  the  filter-generated  truth  solution.  Their 
solutions  showed  position  jumps  on  the  order  of  several  meters,  and  for  this  rea¬ 
son  they  were  discarded  as  potential  truth  sources.  The  differential  GPS  solution 
generated  by  the  airborne  Ashtech  receiver  and  the  ground  based  Ashtech  receiver 
had  data  dropouts  that  made  this  solution  unsuitable.  The  filter-generated  truth 
data  is  not  ideal,  but  it  is  appropriate  to  demonstrate  navigation  accuracy  increase 
or  decrease  as  GPS  measurements  are  removed,  and  baro  and  visual  measurements 
take  their  place. 
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Position  For  Nav  Orbit,  GPS  Filter 


-119.5  -119  -118.5  -118 

Longitude  (degrees) 


Figure  4.1  Ground  Track 


Altitude  For  Entire  Sortie  (meters) 


Figure  4.2  Altitude  for  Entire  Sortie 


Table  4.1  Filter  Configurations 


Filter  Name 

Filter  Description 

GPS  Filter 

GPS  measurements  incorporated  before, 
during,  and  after  the  navigation  orbit 

Unaided  Filter 

No  measurements  incorporated 
during  the  navigation  orbit 

Baro  Filter 

Only  Baro  measurements  incorporated 
during  the  navigation  orbit 

Baro/Vis  Filter 

Only  Baro  and  Visual  measurements 
incorporated  during  the  navigation  orbit 

Vis  Filter 

Only  Visual  measurements 
incorporated  during  the  navigation  orbit 

Unfortunately,  generating  simulated  visual  measurements  using  the  GPS  filter 
resulted  in  minor  errors  in  the  “truth”  position  due  to  time  tagging  errors  (the  GPS 
measurements  were  not  synchronous  with  the  simulated  visual  measurements).  This 
produced  an  error  of  less  than  one  meter  from  the  “truth”  position  used  to  gener¬ 
ate  visual  measurements.  This  is  acceptable  since  the  best  performing  filter  under 
analysis  has  an  approximate  average  error  of  10  meters  (under  optimum  conditions). 
There  are  five  different  filter  configurations  that  will  be  discussed.  Each  filter  has 
GPS  measurements  incorporated  before  and  after  the  navigation  orbit.  They  differ 
only  in  the  type,  or  lack  of,  measurements  that  are  incorporated  during  the  naviga¬ 
tion  orbit.  They  are  listed  in  Table  4.1,  along  with  how  they  will  be  referenced  from 
this  point  forward  in  this  thesis. 

Figure  4.1  shows  the  start  of  navigation  in  the  upper  right  corner  along  with 
the  navigation  orbit.  The  Channel  Island  overflight  is  in  the  lower  left  corner.  Figure 
4.2  shows  the  altitude  for  the  entire  sortie  (in  meters).  The  first  level-off  at  approx¬ 
imately  3200  meters  is  the  navigation  orbit.  The  figure  clearly  shows  some  altitude 
deviations  during  the  orbit.  This  was  due  to  difficulties  in  flying  a  constant  orbit. 
These  altitude  variations  will  be  investigated  in  greater  detail  later  in  this  section. 

Figure  4.3  highlights  the  navigation  orbit  area.  This  orbit  was  flown  at  ap¬ 
proximately  3,300  meters  above  the  ground  and  at  an  airspeed  of  154  meters/second 
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Position  For  Entire  Sortie  (degrees) 


Figure  4.3  Ramp  Area  and  Navigation  Orbit 

(300  knots  indicated  airspeed).  This  resulted  in  the  navigation  orbit  diameter  being 
roughly  5,721  meters  (3.1  nautical  miles).  Figure  4.3  also  shows  the  parking  area 
for  the  test  aircraft,  the  ground  taxi,  both  the  takeoff  and  landing,  as  well  as  the 
navigation  orbit.  The  analysis  will  concentrate  on  the  navigation  orbit.  Different 
combinations  of  measurements  will  be  incorporated  during  this  orbit  and  compared 
with  each  other  to  determine  which  filter  operates  the  best. 

The  orbit  is  shown  in  Figure  4.4.  The  data  was  generated  using  the  GPS  filter 
during  the  entire  orbit.  This  is  the  truth  data,  against  which  the  Unaided  filter,  the 
Baro  filter,  and  the  Baro/Vis  filter  navigation  orbits  will  be  compared. 

It  is  clear  that  the  GPS  filter  performs  much  better  than  the  Unaided  filter 
from  a  comparison  of  Figures  4.4  and  4.5,  respectively.  It  is  also  clear  that  some  sort 
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of  aiding  is  required  during  the  navigation  orbit  GPS  outage  to  improve  navigational 
accuracy.  The  end  portion  of  the  Unaided  filter  orbit,  when  GPS  measurements  are 
re-incorporated,  is  cause  for  concern.  With  GPS  measurements  again  available,  the 
Unaided  filter  operates  more  poorly  than  the  Baro  or  Baro/Vis  filter  (not  shown). 
The  larger  the  disparity  between  the  filter  estimates  and  the  incorporated  measure¬ 
ments,  the  larger  the  filter  gyrations  until  everything  smoothes  out.  The  Unaided 
filter  shows  a  much  larger  lateral  fluctuation  than  the  Baro  or  Baro/Vis  filters.  The 
reason  for  this  is  unclear  when  only  looking  at  Figure  4.5,  this  is  cause  for  further 
investigation. 

4-2  General  Filter  Comments 

The  Kalman  filter  used  in  this  research  is  a  twelve-state  filter.  There  are  some 
minor  problems  with  the  implementation  that  cause  the  filter  to  require  aiding. 
These  problems  appear  to  reside  in  the  vertical  channel.  Problems  in  the  vertical 
channel  are  normal  in  inertial  navigation  systems,  but  this  filter  implementation  ap¬ 
pears  to  be  worse  than  normal.  These  difficulties  were  allowed  to  remain,  as  the  filter 
would  be  continuously  aided  in  some  fashion,  and  the  navigation  accuracy  increase 
or  decrease  can  still  be  determined  when  incorporating  visual  measurements.  These 
problems  are  shown  in  Figure  4.5  where  there  was  no  aiding  during  the  navigation 
orbit.  The  Unaided  lateral  position  solution  clearly  diverges  from  the  true  position. 

GPS  measurements  are  re-incorporated  at  the  end  of  the  6  /-minute  navigation 
orbit.  The  large  lateral  fluctuations  that  are  visible  at  the  end  of  the  navigation 
orbit  are  due  to  the  large  discrepancy  between  the  GPS  measurements  and  the  filter 
estimates  of  position. 

4-3  Unaided  and  Baro  Filter  Cases 

The  results  of  the  filters  without  visual  aiding  (Unaided  and  Baro)  will  be 
shown  for  comparison  purposes  with  the  Baro/Vis  and  Vis  filters.  The  three  dimen- 
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sional  (3D)  error  for  each  of  these  two  filters  is  shown  in  Figures  4.6.  The  Unaided 
filter  is  clearly  prone  to  very  large  errors.  However,  this  is  mostly  due  to  vertical  er¬ 
rors  and  not  horizontal  errors.  The  Unaided  filter  has  the  same  approximate  lateral 
error  as  the  Baro  filter  (350m).  The  Baro  filter  3D  error  is  much  smaller,  but  still 
significant  at  about  350m  for  the  lateral  direction  (approximately  4m  vertical  error), 
ft  appears  that  the  Baro  filter  performs  better  than  the  Unaided  filter  in  the  lateral 
because  of  the  large  disparity  in  the  vertical  error  between  the  two  filters  (note  the 
different  scales). 

4-4  Different  Cases 

Several  different  cases  were  investigated  to  determine  the  effect  that  various 
visual  measurements  error  levels  had  on  navigation  accuracy.  Measurement  errors 
were  modelled  as  white  Gaussian  noise  with  a  standard  deviation  of  <rmeas.  A  name 
is  given  to  each  ameas  value  incorporated  into  the  filter  and  listed  along  with  that  a 
value  Table  4.2  below: 


Table  4.2  Measurement  Cases 


Case 

Case  Description 

Case  1 

“Perfect”  Visual  Measurements 

crmeas  =  5x10“ 13  (radians) 

Case  2 

Nominal  Visual  Measurements 

(Jmeas  =  0.005  (radians) 

Case  3 

Marginal  Visual  Measurements 

ameas  =  0.05  (radians) 

Case  4 

Bad  Visual  Measurements 

(Jmeas  =  0.5  (radians) 
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3D  Error  (meters) 


3D  Error  -  Unaided  Filter 


3D  Error  -  Baro  Filter 


Figure  4.6  3D  Position  Error  for  Unaided  Filter  (top)  and  Baro  Filter  (bottom) 
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4-5  Perfect  Measurement  Case 

The  perfect  measurement  case  uses  a  standard  deviation  for  the  measurement 
noise  uncertainty  of  a  —  5xl0-13  (radians).  This  small  number  means  that  the  errors 
are  essentially  zero.  This  test  is  done  to  demonstrate  the  best  theoretically  possible 
level  of  performance  that  can  be  obtained  using  visual  measurements.  Figures  4.7 
and  4.8  show  the  3D  error  for  the  Baro/Vise  and  Vis  filters  for  Case  1.  This  figure 
uses  the  same  scale  as  the  Baro  filter  in  Figure  4.6  to  demonstrate  how  much  better 
these  two  filters  perform  than  the  non-visual-measurement-aided  filters. 


3D  Error  -  Baro/Vis  Filter 


Figure  4.7  Case  1  —  3D  Position  Error  for  Baro/Vis  Filter 


3D  Error  -  Vis  Filter 


Figure  4.8  Case  1  —  3D  Position  Error  for  Vis  Filter 
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4-6  Nominal  Case 

A  measurement  error  standard  deviation  of  a  =  0.005  radians  is  chosen  as  the 
nominal  case,  using  the  reasoning  described  in  Section  3.5.6.  The  calculated  errors 
in  Section  3.5.6  were  for  a  single  point,  so  the  ameas  used  here  is  roughly  50%  higher 
to  be  conservative.  While  not  exact,  the  nominal  crmeas  value  is  close  to  what  would 
generally  be  expected  from  an  actual  camera.  Figures  4.9,  4.10  and  4.11  compare 
the  Baro,  Baro/Vis,  and  Vis  filters  for  Case  2.  Visual  measurements  clearly  improve 
navigation  accuracy  when  nominal  measurement  accuracy  is  used.  A  more  in-depth 
analysis  of  the  nominal  case  follows. 


3D  Error  -  Baro  Filter 


Figure  4.9  Case  2  —  3D  Position  Error  for  Baro  Filter 
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4-7  Individual  Axis  Position  Comparison 

Evaluating  position  errors  in  each  axis  is  another  way  of  comparing  filter  per¬ 
formance.  In  this  section,  filter  comparisons  will  typically  be  placed  in  a  figure 
composed  of  three  parts,  with  the  Unaided  filter  on  the  top,  the  Baro  filter  in  the 
middle,  and  the  Baro/Vis  filter  at  the  bottom.  The  appropriate  covariances  will 
be  plotted  on  each  figure  as  dashed  lines.  This  is  demonstrated  in  Figure  4.12. 
The  Baro/Vis  filter  used  for  the  position  and  velocity  comparisons  used  a  nominal 
measurement  uncertainty  value. 

Useful  information  can  be  gleaned  by  comparing  each  of  the  filters  to  the  truth 
data.  Figure  4.12  does  this  for  the  North  position  error  between  the  three  filters 
and  the  truth  data.  The  North  error  for  each  filter  is  plotted  using  the  same  scale, 
and  again  there  is  no  clear  difference  between  the  Unaided  and  Baro  filter,  while 
the  Baro/Vis  filter  performs  substantially  better.  The  Unaided  filter  actually  peaks 
at  a  slightly  lower  error  value  than  the  Baro  filter.  The  Unaided  and  Baro  filter 
North  errors  appear  to  be  growing  larger.  This  divergent  behavior  was  expected  for 
the  Unaided  and  Baro  filters.  The  Baro/Vis  filter  shows  no  divergence,  is  bounded 
about  zero,  and  four  times  better  than  the  Unaided  or  Baro  filter  by  the  end  of  the 
time  frame  in  question. 

The  East  position  error  comparison  in  Figure  4.13  shows  similar  performance 
to  the  North  position  error  comparison.  Both  the  Unaided  and  the  Baro  filters 
appear  to  diverge  to  the  same  approximate  value.  The  Baro/Vis  filter  shows  about 
an  80  percent  reduction  in  East  error  by  the  end  of  the  navigation  orbit  time  frame, 
is  bounded  about  zero,  and  does  not  appear  divergent. 

The  Down  error  of  Figure  4.14  shows  much  more  information  pertinent  to  the 
lateral  error  in  the  Unaided  filter  performance  in  Figure  4.5.  The  Unaided  filter 
performance  is  so  much  worse  than  the  Baro  or  the  Baro/Vis  filters,  that  different 
scales  were  required  on  the  Unaided  filter  plot  to  capture  all  the  relevant  data.  The 
Unaided  filter  diverges  immediately  away  from  zero  and  continues  its  divergence  all 
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Figure  4.12 


North  Position  Error  -  Unaided  Filter 


North  Position  Error  for  Unaided  Filter  (top),  Baro  Filter  (middle), 
and  Baro/Vis  Filter  (bottom).  (Dashed  Lines  Indicate  ±  1-er  Filter- 
Compensated  Covariance) 
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East  Position  Error  -  Unaided  Filter 


Figure  4.13 


East  Position  Error  for  Unaided  Filter  (top),  Baro  Filter  (middle), 
and  Baro/Vis  Filter  (bottom).  (Dashed  Lines  Indicate  ±  1-er  Filter- 
Compensated  Covariance) 
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Figure  4.14 


Down  Position  Error  -  Unaided  Filter 


Down  Position  Error  for  Unaided  Filter  (top),  Baro  Filter  (middle), 
and  Baro/Vis  Filter  (bottom).  (Dashed  Lines  Indicate  ±  1-er  Filter- 
Compensated  Covariance) 
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the  way  to  -2200  meters.  This  divergence  would  eventually  lead  the  filter  estimates  to 
become  worthless,  if  measurements  were  not  re-incorporated.  The  disparity  between 
the  filter  altitude  estimate  and  the  GPS  measurement  indication  of  altitude  is  very 
large  at  the  end  of  the  navigation  orbit.  The  Baro  and  Baro/Vis  filters  perform 
much  better  and  show  no  divergence.  Their  error  is  biased  to  about  3  meters,  and 
there  is  no  discernable  difference  between  them. 

All  three  of  the  channels  errors  are  well  outside  the  one-cr  bound  predicted  by 
the  filter  (and  well  outside  the  three-cr  bound  also).  This  indicated  that  the  filter  has 
not  yet  been  tuned  to  perform  optimally.  The  Unaided  and  Baro  filter  covariance  for 
the  North  and  East  channels  (and  the  Unaided  vertical  channel)  grow  over  the  time 
frame  of  interest.  This  is  due  to  the  divergent  nature  of  the  errors.  The  Baro/Vis 
filter  in  all  channels  (and  the  Baro  filter  vertical  channel)  show  covariances  that  are 
relatively  constant  over  the  navigation  orbit  time.  This  is  due  to  the  non-divergent 
nature  of  the  errors  in  these  channels. 

4-8  Position  State  Error  Comparison 

The  first  three  states  in  the  filter  correspond  to  position,  with  State  1  corre¬ 
sponding  to  east  (Sion),  State  2  to  north  (Slat),  and  State  3  to  down  (Salt).  All 
plots  in  each  figure  use  the  same  scale  for  ease  of  comparison  and  show  the  GPS 
“truth”  filter  as  a  dashed  line.  Each  plot  also  has  a  circle  placed  at  the  point  when 
the  takeoff  was  begun.  This  was  placed  on  each  plot  to  discern  between  ground  and 
airborne  data.  This  was  deemed  to  be  of  interest,  because  each  of  the  filters  shows 
some  error  during  the  ground  portion  of  the  sortie,  especially  since  the  aircraft  was 
stationary  for  certain  portions  of  this  time. 

The  Baro/Vis  filter  performance  is  almost  exactly  the  same  as  that  of  the 
GPS  hlter  (see  Figures  4.15  and  4.16).  The  filter  performance  when  GPS  signals  are 
re-incorporated  show  the  Unaided  and  Baro  filters  are  further  away  from  the  real 
position  than  the  Baro/Vis  hlter.  This  is  demonstrated  by  the  large  position  jumps 
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when  the  GPS  signal  is  again  available,  as  compared  to  the  much  smaller  position 
disparity  for  the  Baro/Vis  filter.  Position  error  for  State  3  (Down  position  error)  is 
not  shown  since  the  GPS,  Baro,  and  Baro/Vis  filters  all  appear  to  perform  similarly. 
The  Unaided  filter  performance  is  much  worse  than  the  other  three,  but  this  is  to 
be  expected.  Also,  the  filter  implementation  is  known  to  err  in  the  vertical  channel, 
so  this  channel  is  not  analyzed  here.  The  same  argument  is  applicable  to  State  6, 
the  Down  velocity  error.  The  North  position  error  states  are  not  much  different 
in  performance  from  the  East  channel.  The  Unaided  and  Baro  filters  yield  worse 
performance  than  the  GPS  or  Baro/Vis  filter,  but  nothing  else  is  significant  to  note 
when  compared  to  the  East  channel. 

4-9  Velocity  Comparison 

Next,  a  comparison  is  made  between  the  North,  East,  and  Down  velocities  of 
the  Unaided,  Baro,  and  Baro/Vis  filters  with  respect  to  the  GPS  filter.  The  plots  in 
this  section  are  formulated  similarly  to  those  of  Sections  4.7  and  4.8  except  that  the 
Unaided  filter  figures  are  all  scaled  differently,  since  this  filter  performs  more  poorly 
than  the  Baro  or  Baro/Vis  filters. 

The  North  velocity  for  the  Unaided,  Baro  and  Baro/Vis  filters  are  shown  in 
Figures  4.17,  4.18,  and  4.19  respectively.  The  North  velocity  for  the  Unaided  filter 
starts  out  approximately  10  times  that  of  the  Baro  filter.  The  error  is  bounded  about 
zero  and  appears  to  be  converging  back  to  that  same  value.  The  Baro  filter  performs 
much  better  than  the  Unaided  filter  initially,  and  is  still  performing  better  at  the  end 
of  the  navigation  orbit.  However,  the  Baro  filter  is  divergent.  The  Baro/Vis  filter 
performs  much  better  than  either  of  the  other  filters.  Its  errors  are  much  smaller 
and  not  divergent  at  all.  It  is  noisier  (small  amplitude  noise)  due  to  the  many  visual 
images  incorporated  into  the  filter.  This  can  be  seen  in  many  of  the  plots  produced 
throughout  this  thesis. 
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East  velocity  errors  are  very  similar  to  the  North  errors.  The  Unaided  filter 
error  magnitude  is  several  times  larger  than  that  of  the  Baro  or  Baro/Vis  filters. 
The  East  velocity  may  be  slightly  divergent  (this  is  based  upon  the  local  maximums 
in  the  positive  direction).  The  Baro  filter  is  clearly  divergent,  while  the  Baro/Vis 
filter  error  is  much  smaller  than  that  of  the  other  two  filters  and  is  not  divergent. 

Down  velocity  for  the  three  filters  is  presented  in  Figure  4.19.  The  Unaided 
filter  diverges  immediately  away  from  zero  and  the  error  increases  in  a  linear  fashion. 
The  Baro  filter  and  the  Baro/Vis  filter  are  similar  in  performance  to  each  other.  They 
appear  to  be  slightly  offset  above  zero,  but  are  clearly  not  divergent  over  the  time 
frame  in  question.  As  seen  in  Section  4.7,  the  visual  measurements  seem  to  offer  no 
discernable  advantage  in  the  vertical  channel. 

The  covariance  plots  on  Figures  4.17,  4.18,  and  4.19  indicated  filter  perfor¬ 
mance  similar  to  the  position  error  covariance  plots  discussed  previously.  The  filter 
performances  are  not  nearly  as  good  as  their  own  estimates.  Divergent  channels 
show  divergence  in  their  associated  covariance,  while  channels  that  do  not  diverge 
reach  a  steady-state  covariance  value. 

4-10  Velocity  State  Error  Estimate  Comparison 

Next,  the  velocity  error  states  are  compared.  The  GPS  filter  is  shown  in  each 
figure  as  a  dashed  line  for  comparison.  All  three  of  the  velocities  diverge  away  from 
zero  for  North  velocity  error.  The  Baro/Vis  filter  generates  a  larger  estimated  error 
than  the  Unaided  or  Baro  filters.  The  Unaided  and  Baro  filter  estimates  of  their 
performance  are  approximately  the  same.  These  estimates  do  not  agree  with  the 
actual  errors  that  were  generated  in  Section  4.9,  so  the  filters  are  mis-estimating  the 
velocity  errors. 

The  East  velocity  error  has  all  three  of  the  filters  behaving  similarly  initially. 
The  Unaided  and  Baro  filters  maintain  their  bias  throughout  the  remainder  of  the 
time  frame  of  interest,  while  the  Baro/Vis  filter  converges  back  toward  zero.  The 
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North  Velocity  Error  -  Unaided  Filter 


Figure  4.17  North  Velocity  Error  for  Unaided  Filter  (top),  Baro  Filter  (middle), 
and  Baro/Vis  Filter  (bottom).  (Dashed  Lines  Indicate  ±  l-er  Filter- 
Compensated  Covariance) 
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Figure  4.18 


East  Velocity  Error  -  Unaided  Filter 


East  Velocity  Error  for  Unaided  Filter  (top),  Baro  Filter  (middle), 
and  Baro/Vis  Filter  (bottom).  (Dashed  Lines  Indicate  ±  1-er  Filter- 
Compensated  Covariance) 
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Figure  4.19 


Down  Velocity  Error  -  Unaided  Filter 


Down  Velocity  Error  for  Unaided  Filter  (top),  Baro  Filter  (middle), 
and  Baro/Vis  Filter  (bottom).  (Dashed  Lines  Indicate  ±  1-er  Filter- 
Compensated  Covariance) 
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navigation  orbit  occurs  during  the  four  oscillations  on  the  right  side  of  the  plots  for 
the  GPS,  Unaided,  and  Baro  filters.  The  fact  that  the  Unaided  and  Baro  filters 
maintain  their  error  offset  is  another  indication  that  the  filter  improperly  considers 
its  model  accuracy  to  be  too  high  during  a  GPS  outage.  The  filter  is  estimating  its 
performance  to  be  much  better  than  it  actually  is. 

4.11  Visual  Residuals 

Measurement  residuals  provide  indications  of  filter  performance.  The  residuals 
are  given  by: 

r  =  z  —  h(x“)  (4.1) 

where  z  is  the  measurement  vector  and  h(x_)  is  the  best  prediction  of  the  measure¬ 
ment  before  it  arrives  based  on  the  measurement  model  vector. 

Residuals  should  be  white  and  Gaussian  with  a  mean  of  zero  and  a  covariance 
of  [H(U)P(t“)Hi  (U)  +  R(U)]  [6:229].  This  is  approximately  true  to  first  order  for  an 
extended  Kalman  filter.  Figure  4.22  clearly  shows  that  the  residuals  for  this  simula¬ 
tion  do  not  exhibit  these  characteristics.  This  is  probably  due  to  a  combination  of 
modelling  errors  (both  process  model  and  measurement  model),  including  nonlinear 
effects  that  the  EKF  linearization  ignores  and  system  errors  not  modelled  in  the 
filter  (such  as  estimated  target  location  error). 
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imuth  Error  (radians) 


4-12  R  Sensitivity  Analysis 


A  sensitivity  analysis  is  conducted  to  determine  the  effect  that  the  vision  sys¬ 
tem’s  measurement  error  has  on  the  Baro/Vis  filter  performance.  Figure  4.23  shows 
Case  1  through  Case  4  (described  in  Table  4.2),  and  the  various  levels  of  filter  perfor¬ 
mance  suggest  other  visual  measurement  ameas  levels  be  investigated.  The  difference 
between  Case  2  and  Case  3  is  quite  significant.  Case  2  is  very  slightly  divergent,  and 
has  a  maximum  error  of  approximately  50  meters.  Additional  cases  were  run  with 
different  crmeas  values  centered  around  Case  2,  and  then  several  values  were  chosen 
between  Case  3  and  Case  4.  Cases  1  through  4,  and  the  new  sigma  values  under 
investigation  along  with  their  Case  number  are  listed  in  Table  4.3. 


Table  4.3  Addi 

tional  Measurement  Cases 

Case 

Case  Description 

Case  1 

(7rneas  =  5xl0~13  (radians) 

Case  1.5 

crmeas  =  0.0025  (radians) 

Case  2  (nominal) 

<jmeas  =  0.005  (radians) 

Case  2.125 

<rmeas  =  0.0106  (radians) 

Case  2.25 

<jmeas  =  0.0163  (radians) 

Case  2.5 

crmeas  =  0.0275  (radians) 

Case  3 

crmeas  =  0.05  (radians) 

Case  3.10 

crmeas  =  0.1745  (radians) 

Case  3.20 

crmeas  =  0.349  (radians) 

Case  4 

crmeas  =  0.5  (radians) 

The  results  of  all  the  <Jmeas  values  are  shown  on  Figure  4.24.  The  cost  vs  benefit 
analysis  in  Figure  4.25  is  very  useful  for  determining  how  much  angular  accuracy  is 
required  for  a  given  position  error.  For  example,  an  application  that  requires  a  265m 
or  smaller  error  could  have  an  optical  system  with  up  to  about  10  degrees  of  error. 
This  information  is  strictly  for  this  filter  and  the  single  data  set  used  to  generate  the 
points. 
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3D  Error  -  Baro/Vis  Filter 


Figure  4.24  3D  Position  Error  for  All  Cases 
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Sensitivity  Analysis 


Figure  4.25  Case  2  —  Cost  vs  Benefit  for  Baro/Vis  Filter 


4-13  Error  Correlation  with  Angular  Measurements 

Figure  4.26  shows  north  position  error  plotted  in  parallel  with  the  azimuth 
and  elevation  angles.  The  data  indicates  there  is  correlation  between  the  north  error 
and  the  elevation  angles.  This  is  to  be  expected  since  the  elevation  angle  is  defined 
strictly  in  the  north  portion  of  the  NED  frame.  All  three  of  the  local  minimums  for 
north  error  correspond  roughly  to  zero  for  elevation.  This  would  suggest  that  the 
north  position  errors  grows  as  the  elevation  angle  gets  smaller  and  smaller.  Then,  as 
the  elevation  angle  passes  through  zero  and  begins  to  grow  larger,  the  north  position 
error  is  corrected  back  toward  zero.  The  three  local  maximums  in  north  position 
error  also  occur  when  elevation  error  is  passing  through  zero. 

Figure  4.27  shows  the  same  data  for  East  position  error  as  that  previously 
shown  in  Figure  4.26  for  North  error.  The  data  also  indicates  there  is  correlation 
between  the  east  error  and  the  azimuth  angles.  All  three  of  the  local  maximums 
for  east  error  correspond  roughly  to  zero  for  azimuth,  and  all  three  of  the  local 
minimums  correspond  to  the  azimuth  angle  passing  through  zero  as  well.  The  north 
and  east  position  error  plots  (Figure  4.28)  are  basically  mirror-image  versions  of  each 
other  with  about  a  90  degree  phase  shift  in  them.  This  is  consistent  with  the  circular 
orbit  being  flown,  and  the  slightly  asymmetric  nature  of  the  plot  may  be  due  to  the 
circular  orbit  actually  being  elliptical  in  nature  due  to  wind  effects  on  the  aircraft. 
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4-14  Summary 

A  brief  description  was  given  for  the  sortie  flown  to  collect  the  data  used  in  this 
research,  to  include  the  navigation  orbit  where  the  brunt  of  the  analysis  occurred. 
The  five  filter  configurations  analyzed  were  explained.  The  perfect  measurement 
case  was  shown  to  indicate  the  best  possible  results  that  could  be  expected  from 
this  implementation.  Then,  a  case  was  analyzed  in  depth  for  the  nominal  error  case 
°f  crmeas  =  0.005  radians.  The  Baro/Vis  filter  clearly  outperformed  the  Unaided 
and  the  Baro  filters.  The  Vis  filter  also  showed  promising  results.  Residuals  were 
discussed,  as  well  as  reasons  for  their  clearly  being  non-white  and  time  correlated. 
Lastly,  a  sensitivity  analysis  was  performed  for  R  that  generate  a  cost  vs  benefit 
curve. 


4-36 


5.  Conclusions  and  Recommendations 


5. 1  Conclusions 

The  results  generated  in  this  research  are  clear  as  to  the  viability  of  using 
angular  visual  measurements  for  improving  navigation  accuracy.  This  was  proved 
by  incorporating  “perfect”  visual  measurements  which  showed  the  maximum  errors 
in  this  case  were  20m.  This  is  the  best  performance  that  can  be  expected  from  this 
formulation.  Using  a  nominal  value  of  visual  measurement  error  (0.005  radians),  the 
barometric/ visual  measurement  filter  showed  performance  was  still  quite  good,  as  the 
maximum  position  error  after  the  6  ^-minute  navigation  orbit  was  60m.  Errors  in  the 
horizontal  position  and  velocity  channels  were  much  better  for  the  baro metric/ visual 
than  for  any  of  the  other  filters,  when  compared  to  the  GPS  filter.  The  visual 
measurements  alone  performed  better  than  a  filter  with  barometric  measurements 
only  during  the  navigation  orbit  (125m  maximum  error  vs  340m  maximum  error 
respectively). 

The  simulation  results  should  be  valid,  even  though  an  actual  camera  was  not 
used.  If  an  camera  is  used,  the  INS  tilt  errors  will  have  an  effect  on  performance, 
but  these  errors  grow  slowly  and  are  estimated  in  the  filter.  Therefore,  tilt  error 
effects  can  be  estimated  and  removed,  ensuring  that  visual  measurements  from  a 
real  camera  can  be  used  in  a  similar  manner  to  that  shown  in  this  research. 

5.2  Recommendations 

The  following  recommendations  arc  listed  in  order  of  importance  (most  impor¬ 
tant  first): 

1.  Incorporate  multiple  simulated  targets  to  determine  the  effect  of  more  than  a 
single  measurement  on  navigation  accuracy.  An  R  sensitivity  analysis  should 
be  performed  for  2,  3,  4,  and  5  targets  for  comparison  with  the  single  target 
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cost  vs  benefit  curve  provided  in  this  thesis.  This  would  provide  invaluable 
information  as  to  the  level  of  angular  measurement  error  that  could  be  tolerated 
for  different  numbers  of  tracked  targets. 

2.  Incorporate  actual  visual  measurements  into  the  filter.  This  needs  to  be  ac¬ 
complished  to  prove  the  above  statement  that  implementing  a  camera  into  this 
research  will  not  invalidate  the  method  developed  in  this  research. 

3.  Include  target  azimuth  and  elevation  angles  as  states  in  the  filter.  This  would 
allow  for  errors  in  the  target  coordinates  ( tgtiat ,  tgtion,  and  tgtau)  to  be  esti¬ 
mated  and  dealt  with  in  the  filter.  An  additional  R  sensitivity  analysis  should 
should  then  be  performed  to  determine  how  accurately  the  filter  can  passively 
determine  target  coordinates  with  different  levels  of  angular  measurement  er¬ 
ror.  This  should  be  accomplished  for  at  least  one  to  five  tracked  targets  to 
match  the  preceding  simulated  measurement  data. 

4.  Extend  research  to  include  DTED  data  so  the  planar  image  assumption  can  be 
removed  from  this  research.  This  would  allow  for  local  changes  in  the  earth’s 
surface  to  be  dealt  with  in  the  filter 
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Appendix  A.  Flight  Test  Methodology 


A.l  Overview 

The  PEEPING  TALON  flight  test  actually  supported  two  different  efforts.  The 
main  focus  of  the  project  was  the  navigation  section  required  for  this  research.  Of 
secondary  focus  was  a  limited  camera  evaluation  conducted  on  the  forward  and  side¬ 
looking  video  cameras.  The  limited  camera  evaluation  required  much  more  video, 
under  more  varying  conditions,  so  this  portion  of  the  project  tended  to  drive  sortie 
profile  generation.  This  profile  generation  scheme  was  deemed  appropriate  since  the 
navigation  portion  of  each  sortie  was  only  ten  minutes  long  and  had  more  flexible 
data  requirements. 

A. 2  Sortie  Breakdown 

The  limited  camera  evaluation  had  some  unique  lighting  condition  require¬ 
ments  that  dictated  where  during  the  sortie  the  navigation  section  was  placed.  Some¬ 
times  the  navigation  portion  was  at  the  beginning  of  the  sortie,  and  sometimes  the 
navigation  portion  was  placed  in  the  middle  or  at  the  end  of  the  sortie. 

A. 3  Prior  to  Flight 

The  Ashtech  GPS  base  station  was  setup  in  the  TPS  parking  lot  so  data  could 
be  collected  for  use  by  an  Ashtech  proprietary  program  to  turn  the  mobile  Ashtech 
position  solution  into  a  truth  source.  This  receiver  typically  collected  data  between 
30  minutes  and  1  hour  prior  to  engine  start  until  approximately  30  minutes  to  1  hour 
after  engine  shutdown.  This  extra  time  before  and  after  the  sortie  is  so  the  Ashtech 
proprietary  software  has  enough  data  to  better  characterize  the  errors  present  in  the 
GPS  signal. 
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A. 4  Pre- flight  and  Taxi 


The  GAINR  system  required  a  pre-flight  before  each  sortie.  This  was  so  the 
data  card  could  be  inserted  into  the  system,  and  so  the  Range  Group  technicians 
could  verify  the  system  was  working  and  the  GPS  was  tracking  satellites.  The  TPS 
special  instrumentation  (SI)  technicians  pnt  the  appropriate  lenses  on  the  cameras. 
Video  was  recorded  from  both  cameras  so  the  system  conld  be  verified  as  working 
properly  prior  to  flight. 

Once  the  aircraft  engines  were  started  the  instrumentation  master  power  was 
applied  so  the  GAINR  could  begin  alignment.  This  typically  required  between  4 
|  to  6  minutes.  The  instrumentation  power-on  sequence  was  expedited  due  to  the 
GAINR  alignment  requiring  more  time  than  that  required  to  prepare  the  aircraft  to 
taxi. 

A .  5  Takeoff 

The  video  recorder  was  turned  on  prior  to  taking  the  runway  for  takeoff.  After 
takeoff  the  side-looking  camera  was  selected  when  turning  around  the  Edwards  AFB 
housing  complex  so  easily  identifiable  points  could  be  seen  in  the  camera  FOV.  These 
points  were  then  surveyed  with  an  Ashtech  GPS  receiver  to  accurately  determine 
their  coordinates.  This  information  was  used  to  determine  the  camera-to-body  DCM 
(Cf)  for  that  sortie. 

A. 6  Navigation  Portion  of  Sortie 

The  main  objective  of  the  navigation  portion  of  each  sortie  was  to  record  a 
specific  target  area,  continuously,  for  five  minutes  during  a  ten  minute  block  of  flight 
time.  The  requirement  was  for  at  least  one  measurement  from  each  target  intended 
for  use  be  available  every  ten  seconds  over  that  five  minute  period.  This  would  allow 
for  visual  measurements  to  be  incorporated  into  the  Kalman  filter  for  at  least  five 
continuous  minutes.  The  best  way  to  do  this  was  to  fly  a  circular  orbit  around  the 
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target  area  at  a  reasonable  angle  of  bank.  This  was  to  keep  the  g-level  at  a  low  value 
for  aircrew  comfort,  to  make  the  flying  task  easy  and  repeatable,  and  so  aircraft 
energy  could  be  maintained  without  the  need  for  a  higher  engine  power  setting. 
This  last  was  due  to  the  limited  fuel  capacity  of  the  T-38  aircraft. 

A. 7  Lessons  Learned 

As  with  any  flight  test  venture,  there  were  things  that  did  not  go  as  planned  or 
that  required  some  re-thinking.  Some  of  these  things  are  included  here  in  the  hope 
they  might  help  follow-on  efforts  to  avoid  the  same  pitfalls. 

A. 7.1  Ground  Test.  It  is  very  easy  to  expect  things  to  work  as  planned, 
and  therefore  not  to  plan  for  unexpected  events.  It  is  quite  natural  for  things  to  go 
wrong,  especially  when  humans  are  involved. 

The  aircraft  was  modified  well  in  advance  of  the  beginning  of  flight  test  to  allow 
extra  time  for  problem  resolution.  The  modular  equipment  (listed  in  Table  A.l)  was 
then  removed  from  the  aircraft  so  it  could  return  to  the  general  fleet.  This  was  done 
so  the  equipment  would  not  be  inadvertently  damaged.  The  modular  equipment 
was  then  placed  back  into  the  aircraft  and  ground  tested  to  ensure  the  system  was 
working  properly  before  the  first  flight.  The  ground  test  consisted  of  starting  the 
aircraft  engines,  aligning  the  navigation  systems,  and  taxiing  down  to  the  ATC  tower 
and  back  to  the  same  parking  spot.  Everything  worked  as  advertised  until  the  video 
tape  was  checked  to  see  how  the  cameras  handled  the  taxi.  The  tape  was  blank 
and  it  was  determined  the  Radio  Corporation  of  America  (RCA)  connectors  from 
the  cameras  to  the  digital  video  recorder  were  never  plugged  into  the  RCA  jacks. 
The  first  test  mission  would  have  provided  no  usable  video  data  if  this  had  not  been 
discovered.  This  problem  led  to  the  implementation  of  a  video  check  prior  to  each 
flight.  During  the  aircraft  pre-flight  checks,  v  ideo  segments  were  recorded  with  each 
camera  and  checked  to  ensure  proper  operation  prior  to  each  flight. 
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Tabic  A.l  Modular  Aircraft  Components 
Ashtech  GPS  Receiver 


Video  Recorder 
Forward-looking  Camera 
Side-looking  Camera 
Digital  Video  Recorder 
LCD  Monitor 

A.l. 2  Station  Keeping  During  Circling  Navigation  Maneuver.  The  LCD 
monitor  was  intended  for  use  as  a  secondary  reference  when  flying  the  navigation 
portion  of  the  sortie.  The  intent  was  to  use  it  to  unsure  the  target  area  remained 
in  the  side- looking  camera  FOV  during  the  entire  navigation  orbit.  It  was  unable  to 
be  used  as  a  primary  flight  reference  because  it  was  not  certified  for  that  function. 

It  turns  out  the  resolution  on  the  LCD  screen  was  not  very  good,  so  sometimes 
it  was  difficult  to  tell  exactly  what  segment  of  the  ground  was  being  captured  by  the 
side-looking  camera.  The  LCD  monitor  being  rotated  to  the  right  and  displaying 
information  from  a  camera  pointing  out  the  right  wing  was  not  a  very  intuitive  setup. 
One  of  the  test  pilots  (Maj  Bill  ’’Ajax”  Peris)  came  up  with  another  way  to  tell  where 
the  camera  was  pointing.  The  pilot  would  set  his  seat  to  the  height  intended  for  use 
during  flight,  lower  and  lock  the  front  canopy,  and  draw  a  border  on  the  canopy  that 
captured  the  same  scene  as  that  depicted  on  the  LCD  monitor.  This  way  the  pilot 
had  a  more  intuitive  means  of  station  keeping  on  the  target  area  by  looking  out  the 
canopy  rather  than  having  to  rely  only  on  the  off-axis  displaying  LCD  monitor. 

A.  7.3  Things  Do  Not  Always  Work  The  Way  They  Are  Supposed  To  Work. 

It  would  seem  that  systems  should  work  as  they  are  reported  to  work.  There  were 
two  instances  during  the  test  where  systems  failed  to  function  normally. 

The  GAINR  twice  initialized  in  the  wrong  location.  The  start-up  procedures 
were  followed,  and  system  indications  were  all  normal.  However,  the  GAINR  ini¬ 
tialized  itself  in  the  incorrect  location  and  did  not  correct  itself  until  sometime  after 
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takeoff.  These  errors  were  correctable  by  running  the  data  through  the  Range  Groups 
MOSES  Kalman  filter  program,  but  this  added  an  additional  $2,000  data  processing 
charge  for  each  sortie. 

The  GAINR  did  not  align  during  taxi  as  advertised.  The  PEEPING  TALON 
program  manager  specifically  asked  Range  Group  personnel  if  this  capability  existed, 
and  was  told  that  it  did.  Takeoff  time  was  a  critical  factor  on  one  of  the  night  sorties, 
so  the  aircraft  was  taxied  prior  to  GAINR  alignment  to  save  time.  The  GAINR  ready 
light  (indicating  a  properly  aligned  system)  never  illuminated  before  takeoff,  so  the 
rear  seat  occupant  placed  the  system  in  record  mode.  No  data  was  recorded  to  the 
internal  data  card.  This  error  was  not  recoverable. 

A. 7. 4  Selected  Target(s)  Being  Visible  To  Camera.  The  initial  target  cho¬ 
sen  was  the  Compass  Rose  on  the  dry  lakebed  in  the  Edwards  AFB  complex.  It 
was  chosen  because  it  can  easily  be  seen  from  the  air,  and  there  are  multiple  lines 
intersecting  each  other  that  were  easily  identifiable  and  would  make  good  targets. 
Sortie  0  was  not  an  actual  test  mission,  but  we  were  flying  the  test  aircraft  and 
decided  to  collect  data.  We  orbitted  the  Compass  Rose  and  it  turns  out  the  target 
on  the  lakebed  was  only  visible  during  certain  portions  of  the  orbit.  At  times  the 
Compass  Rose  had  excellent  contrast  against  the  lakebed,  and  at  other  times  the 
it  was  completely  lost  in  the  image.  A  set  of  five  buildings  just  to  the  west  of  the 
Compass  Rose  was  noticed  to  bloom  brightly  in  the  image  when  the  aircraft  was 
across  the  circle  from  the  sun.  The  target  area  was  shifted  so  these  buildings  were  in 
the  center  because  they  could  be  easily  seen  under  almost  all  circumstances.  These 
buildings  were  close  enough  to  the  Compass  Rose  so  the  original  aircraft  orbit  would 
not  be  noticeably  different  than  that  originally  planned. 
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A .  8  Summary 

This  was  a  brief  overview  of  the  PEEPING  TALON  flight  test  mission  that 
generated  the  data  being  analyzed  in  this  thesis.  Sortie  flow  was  presented  along 
with  some  of  the  lessons  that  were  learned  when  flying  real  world  test  missions.  The 
next  chapter  analysis  this  data  and  presents  the  results  obtained  by  incorporating 
visual  measurements  into  a  navigation  Kalman  filter. 6 
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